The castle was build shortly before 1250 by members of the Markwartic family. The first owner cited was Jaroslav of Hrutwice, today Hruštice, who built the castle for his son Vok of Rotštejn. For his second son, Zdeněk, he built Valdštejn Castle and became the founder of the Waldstein family.