Remote Desktop connection

We currently use vpn with a remote desktop connection to our servers. I have some of my users that can get the vpn connection to work, but then when using rdc it tells them that the server is busy or unavailable. I am using the exact same set up and mine works fine. Any suggestions?