No, you don't understand. Direct Input has more lag than Raw Input period. No joystick on the PC that uses Direct Input is going to be as responsive as using a keyboard encoder with Raw Input.
You could support joysticks using Raw Input, and they'd be just as responsive as keyboards. Also, XInput has less input lag than Direct Input, so if you used that, you'd also be more responsive.