It’s all in the title, but looking to see what the timeline might be for enabling Claud 3.5 Sonnet in Discourse AI.
AI-generated summary
The discussion revolves around enabling Claude 3.5 Sonnet in Discourse AI. Falco confirmed that support was added the day of the announcement, allowing any updated Discourse instance to configure Claude 3.5 via the admin panel at /admin/plugins/discourse-ai/ai-llms. Initial testing was done via AWS Bedrock, and jordan-violet confirmed compatibility with Bedrock. A regional limitation required moving to us-east-1 for access Falco. One user jordan-violet reported missing configuration options, prompting Falco to offer an update. Don asked about extending Claude 3.5 to features like topic summarization and image captioning. Sam noted that support is “in the oven” via PR #658, with a suggestion to split implementation into phases. Roman confirmed specs were fixed and merging was pending Keegan’s return. Sam endorsed immediate merging, avoiding unnecessary complexity. Later, Sam reported significant progress with PR #699, calling it a major refactor to simplify future extensions. Finally, Sam confirmed the feature is now merged.
We got it running same day of the announcement, aka yesterday!
Thanks to @roman recent work on making our LLM support flexible, any Discourse instance with the latest update can go to /admin/plugins/discourse-ai/ai-llms and create a Claude 3.5 LLM on Discourse.
Do you use it via AWS Bedrock, GCP Vertex or via Anthropic themselves ? I have only tested it via Bedrock so far.
Bedrock, so this is perfect!
We had to move to us-east-1 because Claude 3.5 Sonnet was only available there yesterday.
Looks like your site need an update, will get you updated.
Hello 
Is there any way to enable it for topic summarization, image caption etc… too? Thanks 
It is in the oven:
https://github.com/discourse/discourse-ai/pull/658
I do wonder though @Roman / @keegan if we just do this in 2 phases, first get the settings normalized and then merge in summary… not sure.
I just finished fixing all specs to make the build green. We should be able to merge this one tomorrow when Keegan gets back 
I don’t see a big upside since migrating the setting values is relatively simple and we are still keeping the old setting around (but hidden). Having said that, I’m not against it if we want to be extra safe. It’s up to @keegan.
Oh if this is ready to merge tomorrow then 
No need to introduce extra complexity.
Update … we ported over a lot of this today… we should be merging more over the next couple of days.
https://github.com/discourse/discourse-ai/pull/699
Its a rather big change but summary will be a lot easier to extend once we are done.
It is merged now!