Gaither was born in 1903 in Dayton, Tennessee. His father was a preacher, and as a youth Gaither expected to also become a preacher. He graduated from Knoxville College, where he had played football, in 1927. Gaither's father died around that time, and Gaither became a high school football coach to help support his family. Gaither later completed a master's degree at Ohio State University in 1937. Gaither died in Tallahassee in 1994.