With your setup (which is equivalent to using an AVGA from GM's point of view), you need to use these options:
lock_system_modes 0
refresh_dont_care 1
If this doesn't solve your issue with rtype etc, then post a log and I'll see what's going on (groovymame.exe romname -v >romname.txt).