I ran it to the lug which was the common ground for my sticks, buttons and IPAC.
My panel is on it's third iteration now, with the trackball plate countersunk, but I previously had it exposed and the trackball plate would often give you a static shock if the ground was disconnected. Not a big deal, but the common ground made that go away.