This is a great topic. I am planning on a removable / swappable panel system and was thinking about something like this since it was going to be a small build. What are the pros and cons that you have found so far? Any "gotchas"?
Haven't really noticed any cons so far. I'm using 4 roller catches on a single player CP; I've been making various test CPs with different joystick/button combinations to try out. It's been extremely simple to swap them out. And they seem reasonbly secure when attached.
The only thing is making sure they are lined up properly when installing them. Although you do have a bit of a margin for error to work with (maybe a 1/4" side to side or so).
I've yet to try it with a 2P CP. For that I would think I may want at least 6, instead of only 4.