Now how exactly would daisy-chaining all the grounds together be helpuful? I did that once with a two-ground board and the results were spectacular. It's like someone else is playing the game for you!
Dennis, I think that if you keep each of the 4 grounds isolated just like they are on the PCB, you can wire up a dedicated control panel. It'll work fine. But you won't likely be able to use the control panel with another controller or keyboard scanner without recombining the grounds back together to a single common ground.
-pmc