What is the importance of Oyster Bay in the nonfiction book, Mornings on Horseback?

The family spent many summers at Oyster Bay riding horses and spending long hours on the water. Teedie later built a house for himself and his family in Oyster Bay.