I did some tinkering yesterday using MAME Plus. Changes were made specific to a game, so I didn't screw anything else up.
Changing the video from GDL if it was set to that and unchecking all types of video filtering made a slight improvement.
Unchecking hardware stretching and substituting scaling=2 for it seemed to make a small gain too. (I never figured out how to change my monitor resolution to fit the game). I'm not really sure how this would free up CPU since I thought these were things the graphics card handled, even if the CPU is handling the initial drawing.
Increasing windows audio latency got rid of some sound skips, lowering the sampling rate didn't seem to hurt anything and may have increased speed.
I read somewhere that disabling all unused input devices will actually make a small improvement...couldn't hurt?
Honestly, I don't really know much about the settings or which ones would use less resources than the other.
I was hoping someone with a better understanding would be able to give some insight.
Any improvement I got was nominal and subjective. At most, I may have gotten a 5% increase in the game I was working with (California Speed on a 3.2Ghz Athlon II - averages 75-85%. Playing without sound ruins it for me worse than running slow)
The one victory I did get was that I discovered one of the clones of Tekken 3 runs a LOT faster than the parent (the other clones are glitchy).
This was on a 2.9Ghz Athlon. It ran, but had some sound skips and occasional slowdown. The clone runs 100%+
This was in MAME 1.35 (or 1.36?). They could have changed by now.