Simms was born 30 Mar 1824 in Virginia to John Douglas Simms and Eleanor Carroll Brent. He married Elizabeth James Nourse about 1852 and he died 24 Dec 1884 in Georgetown, Washington, D. C. He and his wife are buried in Rock Creek Cemetery in Washington D.C. The Simms family was one of public service. His father was the Chief Clerk of the Navy Department. Col. Charles Simms, grandfather of Charles Carroll Simms, was, among other things, an officer in the American Revolution and Mayor of Alexandria, Virginia.