My favorite solution for performing a backup on most systems is to install a removable drive tray.
All you need is an open 5.25" drive bay, and a second frame to use with the backup computer. You can even use a USB to IDE adapter to connect to the second frame.
Or, you could install a slave drive in the removable tray and perform a disk to disk backup. If you install a second drive in a tray as a backup slave, make sure to use a cable select IDE cable and set both drives to cable select.
As to installing a USB card, does the computer have PCI slots?
Is the OS at least Windows 98 SE?
If the answer is no to either question, you cannot install a USB controller.
Even if the system is running Windows 98 or Me, you may have trouble finding a USB card that has a driver for the older OS.
Chas