Ernest Barnes, Jr. was born during the Jim Crow era in “the bottom” community of Hayti, Durham, North Carolina. His father, Ernest E. Barnes, Sr. (1900–1966) worked as a shipping clerk for Liggett Myers Tobacco Company. His mother, Fannie Mae Geer (1905–2004) oversaw the household staff for prominent attorney Frank Fuller, Jr.