I'm working from memory here, but you should only have to remove 1 set screw.
On the coupler, which is also the microswitch activator, there are 2 set screws. Unscrew the one closest to the base of the joystick. The shaft should then slide out of the coupler leaving you with 3 pieces. Mount the base to your CP surface, slide the shaft through from the top, and then reassemble the 3 pieces and tighten the same set screw.