the cross hairs are jittery and when I pull up on the yoke, nothing happens.
Take the game/emulator/other software out of the equation by shutting them down and checking the gamepad properties.
If the crosshairs are jittery, you have either intermittent wiring or bad pots.
A couple of times when I went to the game menu to configure the controls it would start going crazy and the highlighted bar would just keep going up and not stop (even when the yoke is not plugged in).
If by "yoke is not plugged in" you mean the USB cable isn't connected, the yoke/interface isn't the cause.
If you mean that the molex connectors aren't connected, but the USB is connected, that might cause scrolling like what I saw while testing the 4-axis firmware.
Tried using just the SW yoke with the 4-axis firmware and noticed an obvious (in retrospect) but highly problematic side effect with the unused "Z-" and "Z Ro-" axes -- no wiper wire connected to the input = no voltage applied = they aren't centered.
The un-centered Z-axis (a.k.a. mouse scroll wheel) causes the MAMEUIFX menu (and probably many others) to constantly scroll.

Also, with the yoke molex unplugged, the wires connected to the X- and Y-axis wiper inputs could be acting like antennas -- electromagnetic waves passing through the wires induce small voltages which appear as jitter.
The scrolling could also be caused by the potentiometer not being properly centered.
When the controller is centered, you should see approximately 2.5 Volts DC on the X- and Y-axis wiper inputs. (check at the terminal strip)
If you don't see the expected 2.5 Volts:
- Remove the small gear of the off-center axis (28-tooth for X-axis, 14-tooth for Y-axis)
- Turn the pot shaft to the middle of it's range of motion
- Verify that you have 2.5 Volts on the wiper input
- Re-install the small gear -- setscrew aligned with the flat of the pot shaft
when I plugged the female to the male pins box, it actually pushed one of the wires out. I pushed it back in and on the pin and it seemed to start working better, but then it went right back to not working.
You may want to use step 10 in the yoke tutorial to check whether the wiring is intermittent.
I don't know if this would affect it or not, but I'm not sure what the green ground wire attaches to. I'm assuming it attaches to the yoke case for grounding purposes, but I'm not exactly sure where.
It is frame ground.
It connects to the metal frame of the yoke so you don't get fried if a 5v wire shorts to the frame.
I hope it's not a hardware problem with the yoke, like the pots or something.
Bad news: There is a chance that the pots are bad.
Good news: They are easy to replace.
ArcadeFixit has replacements -- search for "5k pot" and select the "Heavy Duty" one.

There are other options out there, but the ArcadeFixit ones are guaranteed to be the right type/size/fit.
Scott