"it will only react with the HDD if it is moving. Since the magnet in the speaker doesent move, it will do no damage."
Umm...what? You do realize that a magnet constantly exerts force lines between the north and south poles and they are what cause the damage to magnetic sensitive equipment, right? It has nothing to do with movement...
"The electromagnetic coil on the speaker might cause problems, but consider this: the little unshielded PC speaker has been sitting about 2" from my high speed/capacity drive for over a year, and I have not noticed a single problem."
The coil magnet in a 2" speaker doesn't have enough field intensity to do any damage unless it's in very close proximity to your hard drive. The coil in a sub, however, will be much larger and more hazardous. I've lifted 20 pound weights using a 10" sub coil magnet.
"Also, is your computer in it's case? Is it metal? If so, this should protect it just fine."
Actually, a PC case being metal will more than likely extend the magnetic flux due to magnetic induction than protect the contents. Depends on the strength of the magnet to determine the amount of risk.
In short, keep magnets away from anything sensitive to magnetic induction (i.e. CRTs, and magnetic storage media). The stronger the magnet, the more space you need. 3.5' should be fine from your monitor, but your PC may be a different issue.