Weber grew up on a farm near Fort Collins, Colorado and played center at Colorado State University from 1951 to 1954, earning all-Skyline Conference honors his final two years. After college he played in the Canadian Football League with the Edmonton Eskimos for a year before a water skiing injury ended his playing career. Weber began his coaching career at Trinidad State Junior College before becoming an assistant coach at Colorado State University.