Discourse AI - Missing settings after update = can't delete my old LLM

AI-generated summary

Cédric_Brunet reports issues with deleting an old LLM model after an update, as the system prevents deletion due to it being in use by ai_helper_model and ai_summarization_model, which no longer exist. He also notes confusion about selecting LLMs for AI Helper independently of personas. sam explains that the settings were hidden prematurely, causing usability issues, and that a fix was implemented via GitHub PRs and discourse/discourse#33535. Roman agrees the settings were removed too soon and plans to restore them during a transition to a simpler configuration via the features page. sam confirms a new feature allows setting a default LLM globally, enabling deletion of old models. Cédric_Brunet confirms the fix works.

Hello,
We just updated discourse after several month without touching it.
We are pleased to see that a lot of work has been put in the AI but I think we are missing something to configure it.
I added the GPT-4.1 and 4.1-mini models to replace our 4o model, but when deleting it, I get this message :
An error has occurred: We were unable to delete this model because it is currently in use by ai_helper_model and ai_summarization_model. Please update the settings and try again.
Both ai_helper_model and ai_summarization_model aren’t existing anymore.

The other problem that I see is that because of that I don’t know how we are supposed to choose the LLM used for AI helper for exemple. I see that selecting a prefered LLM model for all personas has helped move some of the labels like summarize from 4o to 4-mini, but AI Helper label is still on 4o for exemple, and if my memory is good we were indeed selecting which llm is used for what independently from personas before ?

Thanks for your time

I have this fixed per:

https://github.com/discourse/discourse-ai/pull/1494

And

https://github.com/discourse/discourse/pull/33535

We hid the settings but I think it was a bit premature cause it can get very tedious to set the helper setting across a wide amount of models, plus it can be very unclear why you can not delete an LLM.

@Roman will have a look at this and decide if this approach makes sense or not.

The alternative here is to have some shortcut that sets default_llm across multiple personas, and to completely remove all reference to the settings

Yes, it was probably a bit premature. I think it’s correct to restore these settings while we transition to a simpler way of configuring stuff through the features page.

We just merged a feature that lets you pick default llm globally. Can you try it out and see that you can delete your old LLMs?

Hi, sorry for the late response. It works indeed thanks a lot :slight_smile: