LDAP access security

We have recently implemented a mail server architecture that uses LDAP for all the mail ids. We realised a problem that the administrators at the local mail servers can actually access the master directory in the central server and see all the mail ids present in it. We consider it a security issue open to spam. We need help in finding out is there are any access levels defined for LDAP that we can use and implement.