External mail with exchange server 2003

I have set up Exchange server 2003 on our new server and internal mail works great. Anything that is sent to an external account comes back a day later with a delay message. Another day later and it comes back undeliverable. I am out of ideas on what is causing this and feel it may be something simple that I have overlooked. A fresh opinion here would be greatly appreciated.
Thanks in advance