Looks like you should be able to use a resistor, yes. Not much electrical data posted on these things, but one comment gives the current consumption at ~300mA.
Try about a 15-22 ohm resistor. It'll dissipate ~1-2W, so get a 3-5W resistor, and be aware that it'll get pretty toasty. If you can't find a 3-5W, you can wire up 5 75 ohm 1/2W resistors in parallel to get a 15 ohm, 2.5W capable bundle. These should be available at radio shack. Any type of resistor should work in this application, including wirewound.
You could also just try hooking them up to a 9V or 5V power supply. That will dim it substantially. I'd recommend trying this before messing with resistors.