I rotated my desktop with the ATI utility and ran SKjuke. It looks like the only thing that would need work is the album graphics. If you squashed them to the right ratio for vertical display they would probably look ok. The buttons and all the text looks good when rotated.
I am running XP home sp2 with an ATI 9550. The cpu is an AMD64 3400+.