Removed mailbox still receiving mail

We asked for a leaver's mailbox to be removed weeks ago and a customer told us they're still getting auto-replies from it. Looks like it was disabled for login but not actually taken off mail delivery.