That's how it is supposed to work. Each person who sends you email gets exactly one message that you are out of the office. In your message you simply say when you will be back in the office.
Imagine the alternative where every email will be responded to. How many emails do you get in a day? How many of them do not have real email reply addresses? Each of these will generate a rejection message which your server would also respond to with an out of office message. This in turn generates a rejection message which your server also responds to. I don't think you really want to bring down your email server with this message load do you?