When you wired it to the stick, did you reverse the connections between the contacts and the microswitches? It sounds like you didn't.
If you watch the bottom of your stick, when you push up it registers with the lower microswitch. The same goes for when you push right, the actuator pushes on the left microswitch. Up on dpad -> Lower microswitch, Left on dpad -> Right Microswitch. Just take a look at it, you'll see.