The Waltons This is the true story of the Waltons. The show takes place during the Depression and then during World War II. John & Olivia had eight kids, three girls and five boys. One of the boys died at birth; he was a twin to Jim-Bob. John and Olivia's children names are John-Boy, Jason, Mary Ellen, Erin, Ben, twins Jim-Bob & Joseph, and Elizabeth; Joseph died at birth. John's parents also lived with them - Esther and Zeb.