Adam's explanation was very good as a general overview of how to do group policies. The whole idea is to think top down, not bottom up. You want to create a domain or OU policy with all of the settings that you want applied to all of the users and/or computers in that domain or OU. Then, if you want to apply a different set of group policies to another group, create a different OU, move the users and/or computers into that OU and then create a group policy linked to that OU. Generally, I use a domain-wide OU for all of the common settings and then create OUs if I want to apply additional group policy settings to a certain subset of users or computers.
In addition, if you create a domain-wide policy, and then want to create a separate group and NOT apply the domain policy to that group, you can block policy inheritance and/or create a separate group policy for that OU and click the "Enforced" option. Normally, you just "link" the group policy to an OU, but if you click the "enforced" option for a group policy, and then link that policy to an OU, that policy's settings will override the domain-wide settings.
For example, let's say you have a domain-wide policy that sets the user's logon script. Now, you have a group of users for whom you want to use a different logon script. Put those users in a separate OU, create your group policy, link it and click the "Enforced" option. The users in that OU will get all the normal group policy settings from the domain policy, but the login script setting in the enforced group policy will override the login setting in the domain-wide group policy.
Hope this helps you understand the concept of group policies a little better!