Born as Hal Brittan, Baylor started as a boxer, then became a US Marine during World War II, and finally an actor, acting in over two hundred movie roles, television roles and guest starring roles. Perhaps the most famous of these is The Set-Up, a film that benefited from Baylor's boxing experience.