short answer is no. But there are restrictions that can be enforced. ;)
SMS 2003 Remote Tools automatically grant Remote Tools access to the Administrators group. You do not need to add the Administrators group to the Permitted Viewers list.
http://technet.microsoft.com/en-us/library/cc180579.aspx
You can choose to allow administrators to perform all Remote Tools functions, no Remote Tools functions, or limited Remote Tools functions. If you allow administrators limited Remote Tools functions, you can then specify which functions are permitted.
To specify limited permissions
In the Level of remote access allowed list, click Limited, and then click Settings.
In the Default Limited SMS Remote Tools Settings dialog box, select the Remote Tools functions that you want administrators to have for clients of the site. For more information about these functions, see the "SMS Remote Tools Overview" section earlier in this chapter.
Level of permission required for SMS Remote Tools
You can choose to allow administrators to perform Remote Tools functions with or without client permission.
When you select the Do not ask permission check box, using SMS Remote Tools on clients running Windows 98 is less secure than on clients running Windows NT 4.0 or later. Specifically, there is a greater risk of an unauthorized Remote Control session to a client running Windows 98. For this reason, it is recommended that you always display a message to ask for the user's permission on clients running Windows 98. You can do this in two ways:
Select the Display a message to ask for permission option, which displays a message on all clients.
Select the Display a message to ask for permission option, and then select the Only on clients running Windows 98 check box, which displays a message only on clients running Windows 98.
Level of Remote Assistance access
You can choose to allow administrators to use Remote Assistance to fully control applicable clients, to remotely view applicable clients, or to not use Remote Assistance. The level of control that you choose for this setting applies to all Remote Assistance sessions, whether you start them from within the SMS Administrator console or from the operating system.
To enable all site-wide settings for Remote Assistance on the clients, SMS passes the settings to the clients and applies them by using local Group Policy. If you subsequently apply Group Policy settings at the site, domain, or organizational unit level by using the Group Policy Microsoft Management Console (MMC) snap-in, the local Group Policy settings applied by SMS on clients are overwritten.
If you select the Users cannot change Policy or Notification settings for SMS Remote Tools check box on the General tab, the user cannot override these settings on a client.
User permission is always required when using Remote Assistance in the SMS Administrator console