unable to delete email

I delete all email in outlook express turn off outlook express and the next time I go back into outlook express all the deleted mail downloads again. Same mail. Deleted items folder is empty and using dial up connection and windows xp. Any help would be appreciated. Thanks.