A native of Carlisle, Iowa, Randleman quarterbacked at William Penn College, where he graduated in 1964. After a short stint as head coach at Twin Cedars High School in Bussey, Iowa, Randleman returned to his alma mater as offensive coordinator. In 1969, he was promoted to head coach. He left the school after seven seasons with an overall record of 51–17–1, to coach at Pittsburg State University in Pittsburg, Kansas. In 2006, the university named its -square-foot ( m2) strength and fitness center in honor of Randleman.