...to have the operating system and the programs on one hard drive and the data and/or databases on the second drive.
You can also fine tune the system performance by having two drives: the system drive can be an 80GB 10000rpm drive, which is very fast, and the data drive could be 250GB 7200rpm drive.
It is very common to have more than two drives in a server, in a RAID (Redundant Array of Inexpensive Disks) setup where the data is striped to different drives. This arrangement can give performance benefits, but the main reason RAID servers are popular is the redundancy they provide. If one drive stops working, the system can reconstruct the missing parts of the data and the drive can be replaced on the fly, if the drives are hot swappable.
You can keep an image of the system drive as a backup on another hard drive or DVD, should something go wrong. All the data will be backed up from the data drive on a daily basis, or incremental backups could be done even more frequently.
If your system uses Active Directory, it can be backed up to a separate directory on the data drive say at 10PM, and at 11PM the data drive can be backed up to tape or an external hard drive, which is taken off-site to a secure storage the following morning.