Photos help, but I can channel Kreskin.
...
Use a flat screwdriver to remove the "E" clip on the bottom of the joystick shaft. THen pull the joystick shaft up and out (remember the orientation of all the parts that will now fall off, such as the actuator, springs, and other parts).
Now you're free to unbolt the base and you're done.