If they cover the hole when inserted, and the nut holds at the bottom still,
I'd say you can probably just wrap the buttons threads with electric tape,
Or just some foam tubing. Anything to pad the space between the button and the hole. That plus the screw on nut should do it.