Look at the voltage and amperage rating of the lights. If they need +12V, then anything less than 12V will probably make the light dimmer. Anything above it, will make it brighter (and burn out much quicker).
Additionally, the amperage rating (often in Amperes (A) or Milliamps (ma) tells you how much current that light needs. When looking at power devices, you need a device that puts out slightly more current than the amount your light is drawing. If you have signifigantly more current out from your power supply, it is not a concern. What will damage your power supply is not enough current output to power the device (kind of like when too much draw blows a fuse or blows a circuit breaker in your house).
Some ways to get power from lights:
1) run from a PC power supply. You can connect to an unused Disk Drive power connector. These supply +5V and +12V, and check the wiring on your supply for the correct wires to use.
2) You buy low voltage adapters from Radio Shack, Walmart, Target, Fry's, and other stores that supply several voltages ranging usually from 1.5V usually up to 24V, at various current ratings. 1.5V, 3V, 4.5V, 6V, 7.5V, 9V, 12V, 15V, and 24V are the most common. For most incandesent lights, it does not matter if the current is AC or DC.
3) You can look at adapters from devices you no longer use anymore, or may have abandonded that you may still have laying around in your garage or junk drawer that origninally went to answering machines, cordless phones, toys, musical keyboards, or the like. Again, check the voltage and current rating, to see if it is what your lights need.