Outlook is deleting contacts?

I’m stuck on this one. One of our remote employees has a funky ISP that sometimes returned emails as undelivered even if the recipient email is fine. When the email is returned Outlook deletes the recipients contact information automatically. I can’t find any way to tell him how to turn this feature off.