The biggest thing that is going to effect the quality, is the quality of the mp3s. I used to download them, but stopped, because a lot of them were poor quality.
To answer your question directly...
Consider the software that you are using to play mp3.
Your sound card may certainly affect the quality, that and the connection to the reciever.
You should be concerned w/ the power of the pc. I think you should be more concerned if you are going to run a lot of other apps as well, thats when I would be "more concerned" with the PC and ram and such.
For some coin, you can build a Hi-Toned SOB. I have been looking into that lately. Have you considered building a HTPC? Sounds like it might be up your alley.
Good luck, and happy new year.