The Hardy home is an old stone house set in a large, tree-shaded lawn, at the corner of Elm Street and High Street in Bayport, where Fenton and Laura Hardy live with their sons Frank and Joe, and Fenton's sister Gertrude Hardy. It is set in a large garden which also contains a garage and an old-fashioned barn. The ground floor of the barn is converted into a gymnasium. Following their first case, Frank and Joe decided to spend their reward on converting the second floor of the barn into a "crime lab".