Non system disk problems

When I leave a floppy in the drive, non-system disk pops up. The problem is when I remove the disk and press a key it wont continue with boot. Is this a bios setting or somthing?