Restrict computer access to certain users

We have a computer that’s part of the domain. What is the best way to lock that computer down so that only a certain group of users can access it?

Currently we’re running Windows XP for the desktop and Windows Server 2003 SBS for the domain controller.

Thank you.