From what I learned in art school:
The main difference between oil/water and latex is oil and water stain the wood while latex coats it. In other words Latex is better for filling out a rough surface but oil will last longer as it can't chip off. Oil is very hard to work with though and for that reason I'm not so sure it's a better idea, especially considering it doesn't coat on top of latex well.