His father was Michel François Le Tellier (1663–1721), marquis de Courtenvaux, himself son of Louis XIV's War Minister François Michel Le Tellier, Marquis de Louvois. His mother was Marie Anne d'Estrées (†1741), daughter of Marshal Jean II d'Estrées (1624–1707) and younger sister of Marshal Victor Marie d'Estrées. He married twice, to Anne Catherine de Champagne La Suze, and to Adélaïde Félicité de Brûlart de Sillery de Puysieux. He was inspector general of the cavalry and as lieutenant general, he distinguished himself in the Battle of Fontenoy (1745) He was a Freemason from 1736.