duplicate entries in device manager

I have an older compaq presario 500mhz machine with win98. I initially was haveing trouble with my modem but when I went to the device manager I have two entries listed for multiple things. For example to name a few system clock , my comm1 and ltp , standard floppy is listed twice, plus many more. I have the yellow exclamation marks by each duplicate entry. I delete the bad one and windows reinstalls it when I restart. I delete both of them and windows installs 2 back. not sure what to do besides reloading windows(last resort)