I would start by double checking how your "B" floppy drive is cabled into the system.
If the cable has a twist in the wires between the drive connector, and the motherboard, your drive is wired as the "A" drive.
If the drive is indeed wired as the "B" drive, check that the BIOS setting to swap floppy drives is not set to enable.
I have seen a couple of BIOSes that assume that you will only have one floppy, and it will be the "A" drive. If you do not have the option to select an "A" drive, this may be the problem.
Another possability, is that the system originally had an LS-120 drive as the "A" drive, and it is still listed in the hard drive section of the BIOS settings.
As a potential work around;
Set the BIOS switch for reporting floppy drives to windows to disable.
Under the performance tab of system properties, in file system, you may have a tab for floppy drives. Set the option to not search for new floppy drives.
That way, when you remove the floopy, it should stay removed.