Sometimes my desktop seems to freeze

Sometimes my desktop seems to freeze.
When i double-click on a shortcut or select an item from the Start menu, nothing happens. In Task manager i try to kill and restart a new explorer session, but this is not solving the problem. Opening the Start- Run any program sometimes work.
Restarting the server solve the problem, but is not always possible.
All servers have sp6a