If it's a new unit, give it some use and time. The bearings and rollers have a "break in" period where the moving parts seat together with use, and the bearings move more freely. As mentioned, there will always be some differences in movement based on the direction, due to the way a trackball is designed, but it should get better over time.
RandyT