yeah, I know what you mean
I fiddled with it a while before giving up and deciding to live with it
what did actually work for a little while is taking the microswitches off and taping them back on a few centimeters further from the shaft. of course, this only lasts for a day or two before your switches are falling off the stick. if there was a better way to reattach them, this would be a good solution, but I couldn't find one. basically, I was taping them on top of the grooves that hold them in place. This switches don't sit flush with the base, but they don't need to.
honeslty, if your actuator is removable, that'll be your best bet. I think people were replacing actuators on the competitions a while back and it fixed the issue for them. I tried filing the actuator down, but that was too much work.