Tomlinson was born in Amsterdam, New York, but his family soon moved to the small, unincorporated village of Vail Mills, Broadalbin, New York. He attended Broadalbin Central School in nearby Broadalbin, New York. Later he attended Rensselaer Polytechnic Institute (RPI) in Troy, New York where he participated in the co-op program with IBM. He received a bachelor's degree in electrical engineering from RPI in 1963.