The castle was built in an unknown age, although not after the 12th century, since Arab sources mention it in 1172. It has been speculated that the fortification could have been built over a Roman castrum or villa, but no proofs of this have been found. In 1476 the citizens of Villena, encouraged by the bigot Catholic Monarchs, rebelled against the marquisses and killed numerous Jews and conversos who had taken refuge in the castle. After this event, the castle stopped to be residence of the marquisses, and, together with the city, became a royal possession.