I had exactly the same drifting to the left thing with my brand new trackball from Ultimarc. I was told that this is perfectly normal for arcade trackballs, and it's to do with drag from the 3rd roller (the diagonal one that keeps the ball in place). Even the original Atari trackballs did this. I did not find that this effected gameplay on any game because you don't usually let the ball spin for that long.
However, I opened the casing and sprayed some silicone lubricant on the rollers, and this improved the problem greatly (but not completely)