Recycle Bin / Backup drive

I recently got a backup drive. When I started moving folders onto it, I accidentally grabbed and moved the recycle bin on as well. As far as I can tell it is the actual recycle bin and not a shortcut. Is there a way to delete it from my backup drive?