Kaytrim,
Harbor Freight is a great place to get cheap machine tools like a drill press, more than adequate for an occasional user. (I might add this is also the best place for casters for your machines, too.)
Buy at their store if you can so if you end up with a defective part, you'll be able to exchange it. I would get a simple drill press (not radial due to lower accuracy on budget models) in the largest size you are willing to purchase, like a 15".
If you have a *little* more to invest, look at Craftsman from Sears when they go on sale. You can't go wrong quality-wise (possibly baseline, also imported but no junk) and warranty support/parts always.
You will use it for a lot more than you think once you unlock the accuracy it can bring your projects. Buying better than you need is good.
Like any power tool, proper know-how is paramount to operation and safety.
My next floor standing press will be a 20" Delta or Jet.