Although born in Burbank, California, Tommy Cole grew up in the Los Angeles suburb of La Cañada. He was self-motivated toward performing from an early age, despite the disapproval of some of his more strict Lutheran relatives. His father was an editor of the Los Angeles Herald Examiner; his mother later worked part-time at movie studios as a welfare guardian for minor children. He has one older brother, John Cole.