Spinner bushing question

[ahofle]

I recently decided to redo the vinyl control panel overlay under my lexan because you could see my carpentry imperfections (trackball mounting plate outlines and also a wrinkle here and there).  I used this thin rigid plastic sheeting and put the new overlay on it, and then the lexan over that.  It worked perfectly, however as thin as the sheeting is, I have slightly raised the height of the CP and as a result my Oscar spinner knob doesn't attach very well to the shaft anymore because there isn't much room on the shaft past the little white spacer/bushing thing where I can attach it with the set screw.  My question is...can I grind the little bushing down a little to give more room?  It seems very smooth on both ends and I wasn't sure if roughing up one end with sandpaper would change the spinning characteristics.  Any other suggestions? 

Thx,
Andy

[fatfingers]

Could you just route the bottom of the control panel a little so that the spinner will sit up a little higher?  Then you wouldn't risk damaging the spinner.