Born in Kansas City, Missouri, Gadson played with the first line-up of Charles Wright's Watts 103rd Street Rhythm Band, and recorded three albums with them between 1968 and 1970. Along with other members of Wright's band he went on to appear on many hit records, including with Dyke & the Blazers. Gadson started to become well known as a Drummer following the release of the album Still Bill by Bill Withers, released by Sussex Records in 1972. He played on The Temptations album 1990, released on the Motown label in 1973. In 1975 he played with Freddie King on Larger Than Life and went on to record with Martha Reeves, Randy Crawford, Quincy Jones, Herbie Hancock, BB King, Albert King, Rose Royce, Elkie Brooks and many more artists. In 1975 he anchored the Motown classic double platinum album City Of Angels, recorded by Billy Griffin & The Miracles. Gadson was also the Drummer on Marvin Gaye's "I Want You" in 1976, and appeared on two tracks, "At The Mercy" and "Riding To Vanity Fair", on the 2005 Paul McCartney album Chaos and Creation in the Backyard.
