Just configure gpm to use a serial mouse. Its been a while since I've used Linux, so I can't give you specifics.
'man gpm' should give the info you need to reconfigure it. Also, the last time I used Linux (it has been awhile, so this may have changed), you couldn't use two mice at once, so you can only use the one trackball.