External mail to public folder gets bounced

Maybe someone can help me. Currently there is a distribution group in Active Directory that contains a number of users and a Public folder. If email is sent internally to the distribution group the public folder gets a copy. If external mail is recieved everyone gets it except for the public folder, and a bounce back message saying the email was not delivered is sent back to the sender.
Exchange 2003 on 2003 SBS