This location contains four areas. Parts of the first two areas are non-missable, you have to visit them via the story. The third area is accessible via the quest Bravery and Loyalty. The fourth area is unlocked by the quest Kate and Rhagoh.Sweeping Safehold is also a very good place to do the Rush only skill grind trick.