Not much is known about Wolff's personal life. He was born in Bavaria somewhere in the 1910s or 1920s, and moved to Lovia in the 1950s when he was already a middle-aged man. Wolff was an intensely private man who mostly kept to himself, yet was described by his inner circle as "quite charming and with a razor-sharp wit". He had a son in 1966 with an unknown woman (rumoured to have been Brigit Fortesque) who was given up for adoption.