Foster was born on March 10, 1880 in Keene, New Hampshire. He graduated from Cushing Academy in 1899, where he had played on several athletic teams. He spent the next year doing college preparatory work at Cushing and was a member of the graduate basketball team, which was named All-New England champion after winning in a tournament of 35 top teams.