Not much is known about Milito's early life. He was born sometime in the 1940s in New York City. He joined a local street gang called the Rampers which operated in Brooklyn when he was in his teens. Around this time he met future Gambino crime family underboss Salvatore Gravano who had also joined the Rampers. They became lifelong friends and committed crimes together. In the late 1960's. Milito married Linda Milito, who later wrote a book called "Mafia Wife".