Active Directory

Hi all,
THis is the situation, I am trying to deny access to a group call users to a folder that is inside another folder. Lets say deny access to all users to folder \\server\folder1\folder2.
I just want few people who are part of the users to have access to folder2.
When I deny users and add the specify users it works fine but the “big guy” the admin account also get denied. Do I have to then add the “big guy manually?