Cannot enter dungeons

When I use a key to enter the temporal sanctum it wont let me progress past the first door. When I time shift neither of the exits will let me progress to the first floor. I have used 4 keys so far and the same thing has happened every time.