Some additional feedback here. Once the key stopped working, I replaced it with a new key but the AI features did not work, the BOT helper (Forum and Settings Explorer - no response from either and errors in the logs) didn’t work, the AI summarization button disappeared etc.
I tried to disable/enable the AI module from the admin settings, stop and start the container using ./launcher stop app but that didn’t help either. I needed to restart the entire machine the AI functions to start working again.
EDIT: It appears that setting the custom summarization allowed groups to Everyone disables the AI Summarization button for everyone (including staff) @JammyDodger