A native of Brookfield, Wisconsin, Carollo attended high school at Brookfield Central High School where he graduated in 1970. Following high school, he attended University of Wisconsin–Milwaukee (UWM) and graduated in 1974 with a degree in industrial relations. At UWM, he was the starting quarterback for the school's football team from 1970 to 1973.