I think there might be a bug if you choose to stay with the second group? My first time around I did that, and there was no "scary voice" in the cave and clicking on the door latch doesn't let me progress. Then I reloaded and chose to return with the original group, and then the cave sequence worked fine. Did that happen to anyone else?
Look for a lock on the grate at the top of the ladder.
Why y'all can playing this game OMG I want it too but I can't😭😭