Stokes was born in Cleveland, the son of Louise (Stone) and Charles Stokes, a laundryman who died when Carl was three years old. He and his brother, Politician Louis Stokes, were raised by their mother in Cleveland's first federally funded housing project for the poor, Outhwaite Homes. Although a good student, Stokes dropped out of high school in 1944, worked briefly at Thompson Products (later TRW), then joined the U.S. Army at age 18. After his discharge in 1946, Stokes returned to Cleveland and earned his high school diploma in 1947.