He was born 11 September 1884 in Richmond, Virginia to James Robertson Vivian and Hallie Wise Daniel (née Williams). Robert was the great-grand-grandson of Edward Randolph, the first Attorney General of the United States. This account seems to corroborate the accounts of several other survivors who said they saw Smith enter the ship's wheelhouse on the bridge, and die there when it was engulfed.