ACL edits in the panel don't take effect until reconnect

I add an allowed source to my ACL list and save, but existing sessions keep getting blocked until the user fully disconnects and reconnects. There's no indication the change is pending.