out of office assistant

Our out of office reply works fine for internal e-mails, but when an outside person sends an e-mail, no such reply goes out. help?!