Zakharov was born on April 23, 1897 in the village of Shilov, Russia (now in the Saratov region), and began military service in 1915.