Remote Desktop Stops Server 2003 Responding

Hi I was wondering if anyone can help me with a problem I am having. When I remote desktop within the LAN or outside the LAN to our 2003 R2 server it goes into a “hibernate” kind of state. The screen goes off and nobody can access data, users lose connection with Exchange etc. It comes back on after about 15mins. Any ideas, I am desperate!

Thanks