Connect to server through specific port.

I need to remotely access a server through a specific port using terminal services so that I could administer it but I can’t find a way to enter any port info. I have set my firewall to accept a specific port only for this server