Cannot boot with flash drive inserted

I have acquired a USB ‘stick phone’. However, my computer will not boot to Windows with the device inserted. I have tried altering BIOS by selecting ‘No’ for ‘Try other devices?’ but the problem is still persisting.

I have a K7VM2 mobo with American Megatrends P1.30 BIOS 12/13/2002.

Windows XP