Firstly, what you need to do is to severely limit the people who can log on locally to the servers. Thus basically no one except the domain admins or the local admin can log on there. Then lock the servers down.
Next, set up an account giving each of the backup operators the 'backup operators' built-in account priveleges. Give these accounts the ability to log onto the server interactively. You would create multiple accounts to administrate the server for logging purposes (ie who set the backup last night?), but a single service account is needed to link the backup utility to the server.
It is prefferable to utilise the runas utility instead of logging onto a server. And/or setting up consoles in the mmc for the new backup user accounts to link to the backup utility. This way the backup guys can log onto their own user accounts at their workstations and 'runas' to the server to do their backup duties. This is a lot more secure practise.
Of course they would still need to physically put the tapes in the slot. A lot of companies use a stacker so only one person needs to go into the server room occasionally (weeklyish)
http://www.microsoft.com/windows2000/en/advanced/help/default.asp?url=/windows2000/en/advanced/help/windows_security_runas_shortcut.htm