I've built a bartop for 2 players, including a trackball and a spinner per player. It isn't awkward to play but it's only 2 players (check the layout in my Videotron project in my sig). 4 players I can't even think how I'd arrange stuff nicely, but make sure you orient the joysticks correctly. I also agree, small list of games is way better. The more games you have to choose from, the less each one means.
Also, I've spent ages setting up a Pi (retropie) to play these games with 2 spinners, 2 joys, buttons, trackball and an IPAC. It can be done but to get it working it's a lot of configuration and using advancemame for a lot of games. It can be done though.
If you're using a trackball and an IPAC, or basically any number of attached USB devices, each will have their own usb index that can change on each boot up, but you can configure advancemame to use the device IDs so that problem goes away completely. I spent hours figuring this out, kept getting the trackball change index regardless of where I plugged it in so sometimes it would work and sometimes it wouldn't. Just configure advancemame with IDs and it fixes that issue.