O'Dea was born in Kilmore, Victoria, Australia to an Irish-born father and a Victorian-born mother. He was the third child of seven children. As a child he attended Christian Brothers College and Xavier College. As a 16-year-old he received a bronze medallion from the Royal Humane Society of Australasia for rescuing a woman at Mordialloc beach.