This is my first build and my first time working with wood since 9th grade "advanced" woodworking.  My cabinet is complete and I am installing the controls on my CP.  All has gone well, for the most part - until I tried to screw in my Ultimarc U-trak spinner.  Note, this is complete operator error (on my part).
Anyway, I drilled the four holes under my panel and tapped in the four expanding inserts.  When I went to screw in the track-ball, the inserts did not line up with the holes.  I think the trackball must have moved when I was marking the location of the holes.
So, I need to remove 3 of the inserts, fill in the holes, and re-drill the holes.  Unfortunately, I only need to move the holes by about 1 millimeter, which means I will need to drill on the wood filler.  Will this work?  What product should I use and how should I go about it?  I have attached a picture.
Thanks!