Ray was a native of Detroit, Michigan and grew up in South Bend, Indiana. He played football at Notre Dame and at Olivet College. After graduating Ray was the head football coach at Sturgis High School and Three Rivers High School, both in Michigan, and then was an assistant coach at the University of Detroit and head coach at John Carroll University from 1959 to 1963. After leaving Kentucky Ray was an assistant coach in the NFL including as defensive coordinator for the Buffalo Bills. Ray died at his home in Granger, Indiana at age 81 on November 14, 2007.