USB, technically, can have 127 devices connected per USB port (using hubs to plug more than one). Speed wise, I suggest no more that 2-4 real time devices (mouse, keyboard, joystick) per port for USB 1.0 & 1.1 ports; USB 2.0 is faster and probably can take a few more. Any version, don't put a USB drive in the same port as those you want to control mame. As said, PC's have between 2 & 8 USB ports (so you might be able to have 8*127 USB devices, but I don't advice it).
USB can have porblems*, but by now it's usually the driver's fault. USB optipac and ipac seem to be running fine (note: I only have the USB optipac). Under most cases, USB will communicate faster than ps/2.
*Win95 came out before USB and often has problems with USB; dos doesn't do USB (no drivers). WinXP, win2000, win98, and winME are much better with USB (and probably in that order of best to lowest stability, but ultimately depending on the drivers).
With your stuff you list, I'd go USB optipac, probably USB ipac, ps/2 keyboard, and ps/2 spare mouse.