Nevertheless, one really ought to be able to find the anonymous patch of FLOOR through which one entered the cave.
This is why seasoned adventurers carry chalk. Glowing chalk, at that. Damn amateur PCs, running around without the slightest idea what they're doing...
I'd love to see a game where the PC takes really smart actions like leaving chalk marks when he wants to retrace his steps or make notes, or not doing so when he's afraid of being tracked, or crap like that.
"You spy a deep hole. You draw on a small stray stone with your glowing chalk and drop it. As you watch, it hits a stone (inferred by the sound) and the glow disappears around a corner before you hear its final splash. The hole is probably rough-hewn or naturally formed and leads to water."
...but I digress.
Anyway, you came in through the trap door. I think it's fair to be briefed that it's there, just invisible to the naked eye, hidden behind the wall, and small enough that it's hard to mouse over.