Microsoft exchange server

Hi,
Am running exchange server for e-mails, in the address list, I have the all users group, how I can prevent any user from any group to send e-mails to the all users group, and give the privilege to others?