Your men push the ladder down. A few of the Saradominists die, but three of them made it to the top, and kill some archers, until your men finally kill them. Meanwhile, the fortress is getting badly damaged as your men cannot drop stones on infantry burning the building. You are also low on arrows.