usb lock up in startup

My usb locks up my computer in startup before windows starts If I unplug the usb it will start windows when I reboot and I can plug in usb as long as windows is running, even when it first shows up on the screen. I run win 98 se it is updated. The computer is a Dell XPS D300 for other info if needed E-mail me thanks