Floppy Drive Fiasco

What’s happening when explorer or ACDsee keeps showing me the same contents in my floppy drive even though i have switched diskettes? I have to reboot my computer to refresh the contents shown in explorer when working with several diskettes. Is thisa software or hardware problem? Same thing happens even if i use the DOS dir command.