Though most recognised for his television roles, Sweet has appeared in numerous stage productions. These include David Williamson's The Club, and in 2001, Tony McNamara's play The Recruit for the Melbourne Theatre Company. He has appeared in the Frankie Valli-tribute musical Oh, What a Night. In 2013, he performed in Trevor Ashley's musical comedy Little Orphan trAshley with Rhonda Burchmore.