He met and married Barbee Biggs in summer stock in 1958; the couple have several children. In a Los Angeles Times interview in 1985 titled "Autistic Youth Thrives in Large, Loving Family", the Swoffords discussed bringing up their autistic son Brendan at home.
Between 1962 and 1995, Swofford's film credits included Thelma and Louise, Skyjacked, Black Roses and The Andromeda Strain, while his TV career during the same period was prolific.
In an interview in 1976 the distinctive, red headed actor described the advantages of an acting career as spending more time with his children and having the freedom to do any job. "If you're an actor, you can do anything. I have cleaned carpets, painted houses, worked on loading docks. It didn't bother me, because I could always act and enjoy myself."
In 1989, Swofford was convicted of felony drunk driving and sentenced to 28 months in prison, after which he made a comeback and continued to work steadily until a retirement in 1995. In 2001, he supplied the voice of the coach in Recess: School's Out, and played Officer White in Teacher's Pet (2004), which was his last role before retiring permanently. He measures 1,84 meters.
