Windows Mail sends 2 copies of every email I send

I am a Windows Vista user. I have set up my email to be sent and received through Windows Mail. Every time I send an email using Windows Mail, the recipient complains that they get two copies of the same email from me. What is wrong with Windows Mail and how can I fix it so it doesn’t happen again?