Bliss was born in New York City and attended Yale University, where he played halfback. With his brother, Laurie Bliss, in the same backfield, he led Yale to back-to-back national championships and undefeated seasons in 1891 and 1892. Coached by Walter Camp, Yale did not allow opposing teams to score a single point in those two seasons.