one thing to consider too is make sure you joysticks arent too close to the sides. on one of my panels, my p1 joystick hole was 3" in from the left edge, which seemed fine, however i had a 1/2" overhang over the box below the control panel...to make a long story short, i had to notch out the inside wall of the box so i had room to connect the wires on my joystick switches.
mockups are always a good choice, get a cheap thin piece of wood, doesn't have to be pretty, even panneling or luan would be fine