Totleben was born at Mitau in Courland (now Jelgava, Latvia). His parents were of German descent, belonging to the merchant class, and he himself was intended for commerce, but a strong instinct led him to seek a career as a military engineer. He entered the school of engineers at Saint Petersburg, now Military engineering-technical university ().