He became "a major force in the development of American railroads, hotels, and real estate," and served as a director of the Chemical Bank in New York, the New York Trust Company, the City Investing Company, the Fifth Avenue Corporation and the Real Estate Mortgage Commission. After his mother's death, acknowledging the change in the neighborhood from residential to commercial, he had the family home, 608 Fifth Avenue in New York City, tore down and commissioned Victor L.S. Hafner to design 608 Fifth Avenue, which stands to this day. In 1947, he attempted to donate Ochre Court, his parents' châteauesque mansion designed by Richard Morris Hunt in Newport that was the second largest mansion in Newport after The Breakers, to the United Nations as their headquarters. They did not accept the donation and instead, Ochre Court was donated to the Sisters of Mercy for the formation of Salve Regina College, the first Catholic women's college in the state of Rhode Island.
On June 14, 1904, Goelet was married Marie Elise Whelen in Philadelphia with Alice Roosevelt as one of her bridesmaids. She was the daughter of Henry Whelan Jr., a prominent banker from Philadelphia, and the sister of Laura Whelan, who was married to Craig Biddle. Before their divorce in 1914, they were the parents of two sons:
Ogden Goelet, who married five times, the first being to Florence Enid Connfelt in 1933. They divorced in 1938, and later that year, he married Maria Virginia Zimbalist, the daughter of singer Alma Gluck and violinist Efrem Zimbalist. They divorced in March 1941, and in April 1941, he married Mimi Nicholson Browne, whom he also divorced. He later married for the fifth time to Sarah Sherborne Haigh in 1963, remaining married until his death in 1969.
Peter Goelet
On October 22, 1919, he remarried to Donna Fernanda, the Princess Riabouchinsky at the American Church in Paris. Donna was born in Perugia, Italy and was the former wife of Prince Nicholas Riabouchinsky, a close friend of Goelet. The marriage reportedly infuriated his mother, who refused to receive his wife, and she cut him off from his share in her personal fortune, closed her New York home, her Newport home, and went to England to live. They eventually won over his mother four years later after the birth of a son, but the couple divorced in 1924 and she was later known as the Duchess de Villarosa. Donna and Robert were the parents of one son:
Robert Wilson Goelet, Jr., a film producer who first married Jane Potter Monroe in 1942. They divorced, and in 1949, he remarried to Lynn Merrick. After their marriage, his mother disinherited him. After a "stormy" marriage, they divorced in 1956.
On September 24, 1925, he married for the third time to Roberta Willard, the daughter of Col. Joseph Willard of Newport. Roberta had reportedly been voted "the prettiest debutante there in 1916." Both of their mothers were ill and could not attend the wedding, with her mother dying a month later, and his mother, a few years later in 1929. Together they were the parents of a daughter:
Mary Eleanor Goelet who married James Eliot Cross in 1949. She later married Harold C. King.
Following his donation of Ochre Court in 1947, he purchased a home known as Champ Soleil, designed by Polhemus & Coffin and located at 601 Bellevue Avenue in Newport. He served on the boards of Bailey's Beach and the Newport Country Club, both of which were co-founded by his uncle, and which he was one of the largest shareholders. In New York, he was a member of the Knickerbocker Club, the Harvard Club, Turf Club, the St. Nicholas Society, the Piping Rock Club, and the Tuxedo Club. He also owned a plantation near Charleston, South Carolina, and was the builder of Glenmere mansion, his estate on the Hudson River built in 1911 and designed by Carrère and Hastings, where he entertained Babe Ruth and the Duke and Duchess of Windsor. Glenmere was a 62-room manor house in the style of an Italian villa set on 1,322 acres. Goelet died at his home, 4 East 66th Street in New York City, on February 6, 1966. His funeral was held at St. Thomas’s and he was buried at Woodlawn Cemetery in the Bronx. He was worth an estimated $50,000,000 at the time of his death. A month after his death, the Chemical Bank of New York, as executor of his estate, listed his New York apartment, which was the entire sixth floor of the building at the southeast corner of Fifth Avenue and East 66th Street, for sale for $240,000. In October 1966, Goelet's collection of 18th century French furniture, porcelain, and other valuable objects from his New York and Newport homes were auctioned off by Parke-Bernet in New York.
Descendants
Through his eldest son Ogden, he was the grandfather of Ogden Goelet Jr. and Enid Goelet, who married Ranald Trask McNeil, a graduate of Columbia University School of Painting and Sculpture who served with the U.S. Air Force in Korea, in 1955.