Fraser played junior hockey with the Kitchener Rangers of the Ontario Hockey League from 2004–06. In his second season with the Rangers, his hard working style earned him the captaincy after Mike Richards left the team. He was selected by the New Jersey Devils in the third round, 84th overall, of the 2005 NHL Entry Draft. At the end of the 2005–06 season, he played his first professional games, joining the AHL Albany River Rats for four games. He played his first full professional season in 2006–07 with the Lowell Devils, and he played seven games for the New Jersey Devils as well. He remained with Lowell until 2009–10, when he made the New Jersey roster out of training camp.