How do I rotate removable hard drives and keep the same drive letter?

I’ve set up a Windows 2003SBS to backup to a removable hard drive named X. However, when I put the alternate hard drive in, it names it the next drive letter available, even though I previously named it X. Is there a way to keep this from happening?