She married her first husband, Martin Sacker, in 1944, and divorced him in 1951. Subsequently, Cabot was romantically linked with King Hussein of Jordan for several years. She bore her only child, a son, in 1961. In 1968, she married her second husband Michael Roman with whom she raised her son, Timothy Scott Roman, before again divorcing in 1983.