It appears as a regular ant hill entrance. The interior layout is almost identical to the warren. It features several long, narrow tunnels that are dotted with cave fungi, among other things. At the end of the tunnels, there is one round room with two corpses. The interior has waste piles which may contain ant nectar, and a few lootable corpses with common items.
The musty caverns appear only in Fallout 3.