Williams, originally a five-star running back out of Royal High School, started his college football career at Oklahoma. After finishing his true freshman season as the fourth-leading rusher for the Sooners, he decided to transfer to Texas A&M. He sat out the 2012 season due to NCAA transfer rules and played two more seasons at running back before Aggies coach Kevin Sumlin switched Williams to cornerback in his senior season.