how to assign group log on locally right

I want to create a group in active directory for each server in my domain and then give each group the right to log on locally to that specific server. I need to be able to restrict who can log on to the server console to Administrator and the specific group for each server. I think this is done the group policy settings on the local machine but I am confused about how domain or OU policy settings might override the local settings. Do I need to create a new OU and move all of the servers into it first?

I am looking for specific instructions or links to detailed articles.