McWillie was born in Kansas City, Missouri. He resided in Dallas, Texas from 1940 to 1958 where he at one point worked for Dallas mob boss Benny Binion and was employed at the Blue Bonnet Hotel and the Top of the Hill Terrace, a gambling club in Arlington, Texas. McWillie also ran a gambling house in Fort Worth called the Four Duces.