I currently run my retro console emulators off a USB stick with no problems. I can't imagine a USB hard drive being an issue.
Well, I could see ONE problem. If you moved it from one comp to another, the drive letter might change. Which could screw with any configs you have on there for ROM paths and such.