He was the son of Admiral Sir George Bowyer, 5th Baronet and his second wife Henrietta Brett, daughter of Admiral Sir Piercy Brett, and was born at Radley Hall in Berkshire. In 1799, he succeeded his father as baronet. Bowyer was educated at Christ Church College, Oxford, where he graduated with a Bachelor of Arts in 1804 and a Master of Arts in 1807.