That sliding control panel is a very innovative idea, well done.
There are so many great ideas on how to maximize your controller options without a huge frankenpanel, but all of them have a compromise of some sort.
The main drawback of the drawer (pardon the pun), is that the trackball doesn't have any clearance for golden tee/bowling style games.
Just a thought, but could the trackball drawer slide out, then (at the back) be optionally angled upwards to give clearance over the main control panel?