Pancholy was born in Dayton, Ohio. He moved around while growing up. His family comes from Gujarat, and his grandparents live in Ahmedabad. He is a 1991 graduate of the Berkeley Preparatory School in Tampa, Florida, and went on to major in Theatre at Northwestern University, where he received his bachelor's degree in 1995. He then attended the Yale School of Drama, where he received his Master of Fine Arts in 2003.