Duffy was born in New York City, the daughter of Carol, a homemaker, and Phil, a developer. She attended Park Ridge High School in Park Ridge, New Jersey, graduating in 1979. She received a bachelor's degree in recreational therapy from the University of Colorado at Boulder.