From a private message:
The atari 4.5" tball did not use anything on the rollers to protect the ball, nor did any trackball that I've ever seen. This trackball used fairly large rollers and bearings (3/8" diameter, I think).
If I were to build one, I would start with
www.mcmaster.com. Their part number 98381A634 is a 3/8" hardened dowel pin 2.5" long (maybe it's long enough, I haven't gone through the math?). Then look for ball bearings designed for 3/8" shafts, also available from mcmaster. The steel, or aluminum, frame could be built from flat or angle stock available from Home Depot or mcmaster.
As for the project, I haven't really come up with much yet. Go
hereFor the exploded mounting view of the trackball.