Yes he is. Charles and V.V. aren't blood brothers. Like Mao and C.C. C.C. became Mao's so called mother when he was six. The same thing goes with Charles and V.V. V.V. gave Charles the Geass and they stuck together because of the contract.