Autoresponder sends twice

Set an out-of-office in webmail and a couple of people replied saying they got the auto-reply twice for one email. Turned it off in the end.