N64 sucks without an analog stick. It also sucks on a control panel. Get a gamepad with analog and enough buttons or better yet an N64 joystick.
If you just want to say "look, I've got N64 on this beast, too!" then it doesn't matter how you set it up. If you want to enjoy playing it, don't use the CP.