You will get responses all across the spectrum on this, and in particular instances, everyone is right
Lag discussions aside...
The zero delay boards only understand keystroke inputs (like what a regular old microswitch joystick and buttons will produce) so for a basic joystick/button panel they are adequate.
Interface boards from Ultimarc and GroovyGameGear for instance can convert the output from trackballs, spinners, potentiometer driven controls like analog joysticks and pedals, hall effect sensor joysticks, etc. into input that your PC or Raspberry Pi can understand.
These are things a zero delay board cannot do.
I can't speak to the actual speed/accuracy of Zero Delay boards and some of this depends on what you use for a computer and display anyway.
The zero delay and cheap joystick I bought for my first controls for my first control panel prototype were a horrible experience for me.
I abandoned those immediately for Ultimarc products and have been very happy with the results ever since.
Not only have the I-PAC2, Mini-PAC and U-HID I bought been problem-free, support from Andy (especially if you can ask very specific questions) has been stellar right on through and for what they are capable of, they are really easy to set up.
If you want to choose the right interface then you need to first decide exactly what you want to build for a control panel, i.e. what types of controls you want to use.
Exceptions would be a U-HID board or Arduino, because those can be programmed to mimic pretty much anything.