Entrances to the dungeon are found as holes in the bedrock--this is only one entrance type of many. Dive in!
A Vine Entrance
Mush Danger
Magma Chamber
This hallway looks suspicious...
A room.
Seems the villagers had a bad time in here.