2003 server terminal services!!

I wanted to know about security issues regarding the Win 2003 server terminal server and if its safe to open the terminal servers port and point it to my server so I can Aceess. I’m asking this since for some a certain reason I can’t use VPN. So I wanted to know if it is safe to just use TS.

thanks