Several Ways:
The first step is to note the voltage and the current draw of the lights. Then, from there, see below.
1) Use the PC Power Supply If the voltage is +5V-6V or 12V-14V, and under 700ma, you can probably run them from a PC supply, using the +5V, or +12V wires from an extra disk drive connector. Just build an adaptor for this.
2) You can buy a transformer from radio shack, or the like, with the appropriate voltage and the proper current rating. It does not matter if the voltage is AC or DC.
3) The last way, is to look at adapters that you have laying around, from devices you no longer use (such as toys, adding machines, answering machines, etc), and see if one matches the required voltage and current draw ratings.