The caves were created by a group of dwarves searching for the source of the pure sacred water that flows through the Kharazi Jungle. Something apparently went wrong while they were creating the caves, as they and those who came after them were ultimately unable to find it, most perishing in their attempt.