Outlook2002 attachment from floppy prob.

Using Outlook 2002 with W2K Pro. every time I attach a file to a new e-mail from a floppy the a: drive stays as the default location.So if I use another application the PC automatically checks the floppy drive which is rather annoying if I have taken the floppy out.
This happens with any floppy,and I can “fix” it by opening a new mail and pretending to attach a file but instead just changing the location,which comes up as the A: drive,to anything else eg My Documents.
Any ideas ??