I would think 4 amps would be enough for lights, especially if they are all LED lights.
You can try the stereo amp, but if it pushes the power supply too much, the power supply will most likely turn off, you would have to reset it powering it down then back up.
Might be better to go safe and power the amp from 230 V, if thats not going to be a problem.