Windows DNS – MX lookup failure

I’m setting up my own DNS server. Everything is working fine except for sending emails. I could browse my website and receive mails. But when I send an email, my email server returns an error stating that my return address is not formatted properly or it cannot perform a reverse lookup. I have created A, CNAME, MX and PTR records for my website. How do I fix this problem?