Prevent Out of Office replies internally

Is there a way to prevent “Out of Office” replies to go to internal staff? (I’m talking about replies that we create internally.)

Thanks!