Not at all. Replace away.
The voltate rating isn't how much it'll allow the cap to pass thru it, it's the maximum voltage that the cap will take before *pop*.
The only caveat to a larger voltage cap is the more voltage they handle, the bigger they are. With such a small increase in voltage, I doubt you'll have any problems. Unless you went from a 16V to a 250V, then you might have a problem!

Edit: also, you don't want to mess with the