logging off 2000/2003 terminal server

Lately our users have been having problems logging off of our windows 2000/2003. They click on start, shut down, log off and it takes anywhere from 5 to 10 minutes to log off from the server. This happens using remote desktop on servers that set up as application mode as well as remote administration mode. Is there any way to make the logging off process go quicker?