The Avatar found him in the jail of Yew in Ultima V. He'd given up all hope, especially since he hadn't heard of his son Froed in a long time. However, when the Avatar told him that Froed was well in Skara Brae, Greymarch gained new hope and told the Avatar that the Sceptre of Lord British is very powerful and to consult Sir Simon in Bordermarch.