It is good that you didn't try to rotate the P3/4 controls.  That was my biggest issue with trying to build a 4 player panel, and ultimately I opted for a 2 player control panel.  Best advice anyone gave me though, was to mock it up on cardboard and make sure all of the controls feel comfortable.  Good luck!