TinyXP (at least the version 06 that I'm using) has 4 different installation types. You can pick with or without drivers and with or without IE, outlook, etc in any combination.
IIRC, I installed without drivers, without outlook or IE, then installed my motherboard's drivers which included a USB driver and network, so I was up and running fine with my U360s and sharing files on my home network in just a few minutes.
Either way, TinyXP is the way to go. Without all the bloat, it boots insanely fast and installs in a couple hundred meg at most.
Just a word of warning: After it copies all the files to the hard drive and reboots for the first time, my machine didn't put a message on the screen telling me to wait. All I got was a mouse pointer on a black screen. Don't panic. Just go get some coffee and come back in 10 minutes or so and you'll eventually have it installed.
-jeff!