Thing is, most hifi-stereo speakers are hi power and 8-16Ohm, and but your PC speakers are most likely low power and 4Ohm and the amp is driving a signal for that. That s why the volume is so low. And the impedance is wrong. So this setup will only ever sound OK, but never great.
I suggest that you try to find an old stereo amp and use that with those speakers of yours.
Otherwise, a cheap option is to find some good quality PC amp/speaker units or other 4 Ohm speakers.
If you have some old PC speaker units around, get the best sounding ones (I like using Harmon-Kardon units) and pull the amp out of that. My cab needed 4" speakers and the HKs only have 3" speakers, but I found another PC speaker unit that 4" speakers and cannabalised that.
PC speakers are a good choice because they usually have magnetic shielding built in, which means it won't f*ck with you monitor. You can often find them cheap at auctions and garage sales, or even people giving them away. You can do some chopping and changing between amps and speakers, so long as they are roughly the same ratings (like most desktop PC speaker units would be).
As long as there isn't an extreme difference in their power ratings, You won't blow your speakers by attaching a 4ohm amp to 8 or 16 ohm speakers. But you can do it the other way around, eg by connecting 4 ohm PC speakers to a hifi amp designed to drive 8ohms+.