Harris attended El Camino High School in South San Francisco, California. Harris received a bachelor's degree in 1968 and a master's degree in 1969 from the University of the Pacific, where he played college football. Harris served as offensive coordinator at Tennessee under Johnny Majors, helping the Volunteers win four of five bowl games while there. In 1989, he became head coach at the University of the Pacific. As head coach of Pacific, his staff included future NFL head coaches Jon Gruden and Hue Jackson.