How does Windows load device drivers?

Many times when a device doesn’t work on a computer, you can uninstall the device in Device Manager, and when the computer is rebooted, the device works again. But rebooting the computer without first uninstalling the device does not make the errant device work. Are the drivers loaded from a different area after the device has been uninstalled as opposed to when the device has already been installed?