At the least you have to split up different emus. The reason behind this is certain emus share rom names for totally different games.
Personally I go a few steps further a split up my mame collection by major drivers (neogeo, cps1, cps2, vs ect).... The reason I do it is more of a convenience thing, so that they are easier to burn to cds if need be.