3 keys:
One by repairing the ruins west of Smuggler's Swamp (aka NW corner of SF)
Two hand in butterfly wings (From tower) to the guy in the chapel in LV
Three take the key from the boss smuggler in the swamp go to LV head all the way south and find the door that heads south. Go kill a mini boss and get another key, don't use chests they will recall you, then go find the boss, which drops a head you hand in west of Smuggler's Swamp. Go thru the portal to the flower farm. Find the 3 odd flowers, map in guides, hand in to make another key. Open building to the east kill the guy, chest contains Shield Quest, Use the picture frame. Then head west to the portal and use until you get to a small room of red/green (don't worry no death traps). One portal leads to wand quest the other to staff. Once you finish the little section you have to recall.
Go thru smuggler's swamp and get the 3 keys, then walk thru the doors in that NE corner, keys do disappear. Make sure you use the Easter Shrine to activate portal.