Remote Desktop Permissions

I am having issues with users accessing a server remotely in a domain environment.

If i right click the “my computer” icon on the desktop and select remote users and add a user into there on a PC the user can access the PC fine. However, If i do the same on any of the company servers the users are unable to connect.
They get a logon message error telling them they are not part of the Allow logon through Terminal serverices.
How do i resolver this?