Your pictures show two big problems right off:
You've got cable spaghetti completely blocking all airflow from the front of the case. Tidy up the cable routing with airflow in mind.
Your stock Intel heatsink is totally clogged with dust. The fan can't cool the processor if the air can't get in between the fins on the heatsink. A can of compressed air will blow that gunk out.
To answer your questions:
What's the "right" temperature? Hard to say on a P4- they will throttle themselves down if they get too hot, in an attempt to produce less heat. So it's hard to actually get it too hot, as far as burning the processor is concerned. But you obviously don't want it to get hot enough to slow itself down, either. Unfortunately, the magic temperature that throttling kicks in at seems to be different for different individual processors. I'd want to get it at least under 60 even during heavy use, and cooler is obviously better.
Your heatsink fan is attached correctly. Intel ships those stock coolers exactly the way it looks in your photo. There's a lot of debate about whether they
ought to blow into or out of the heatsink, but every stock cooler and most aftermarket ones I've ever had were installed so it blew in. I've seen tests online that showed no difference either way. A better question is: Was the heatsink mounted well? If the thermal interface material got botched when the processor was mounted, that can keep heat from being properly transferred from the chip into the heatsink.
Most power supplies are standard, but not all. I can't see yours in those pics. If your computer uses an ATX power supply, it's standard. But SFX power supplies are out there too, as well as some more exotic proprietary designs. Is this a name brand computer, or one put together by a local shop or "some guy"? Generallyl, you find the oddballs in name brand machines. A pic would nail it down, or even just measurements of the size of the PSU.
Here's one of Seasonic's most efficient 400w units, for $99.00 -
Here.Here's a less efficient model at $76.00:
Here.Here's a 350w for $57:
Here.But, Hey! I just found a killer deal at Newegg on this Antec 400w unit, $54.99 now, but only $24.99 after $30.00 Mail-In Rebate:
http://www.newegg.com/Product/Product.asp?Item=N82E16817103935There's a review on it's 450watt brother here: http://www.silentpcreview.com/article260-page1.htmlThe Ultra-120 is just one heatsink, although it can be ordered with different mounting brackets to fit different CPU sockets. It is top of the line, and the price reflects that, it's $46 if you order it
here. If you want to go cheaper, the
Ultra-90 is only $25 and ought to be perfectly adequate. Either one ought to fit your motherboard, although of course I can't guarantee it. But they're designed to have a very small base so as not to conflict with any motherboard components.
The store linked above has fans and thermal paste as well. I use the Actic Silver 5, and the Nexus and Scythe fans are very good and very quiet. It's not really hard to apply the thermal paste, and you'll get a tube with enough to do it about a zillion times, so if you think you've screwed it up, just wipe it off and do it again. Basically, the idea is to spread the thinnest smooth, even layer you can manage.
If I were you, I'd start by cleaning up that cable mess and blowing all the dust out of the heatsink. Next, I'd try removing the heatsink, cleaning it and the processor base off with Isopropyl alcohol, and then re-attaching it with some Arctic Silver- if you've got a good PC shop in town, they may carry it. Next step would be the PSU, since you say that's where the case is so hot, and because the rebate ends Jan. 15. I'd replace the heatsink last, because truthfully, in a properly ventilated, non-overclocked system, a stock cooler is adequate.
You might also post a pic of where your side fan is mounted. That may shed some light on any airflow issues- ie, is the air from that fan going where it needs to, and is everything in the case getting adequate airflow? Also a pic of the PSU to verify it's ATX.