I may be completely off here and this is common knowledge to everyone but me… If so, I am sorry. But I have hade some strange errors in my installation, such as: DiscourseAi::Completions::Endpoints::Anthropic: status: 400 - body: { “type”:“error”, “error”:{“type”:“invalid_request_error”, “message”:“This model does not support assistant message prefill. The conversation must end with a user message.”},“request_id”:“req_011CcqMN6eswEfRHPmQmPLC4” } Which was strange since most other AI-related stuff worked. This happened primarly with my summarizer and with search as in: https://..../forum/discourse-ai/embeddings/semantic-search?q=search_term Which gave a 500 ERROR. When I checked logs I got: { "type": "error", "error": { "type": "invalid_request_error", "message": "This model does not support assistant message prefill. The conversation must end with a user message." }, "request_id": "req_011CcqQvXPAHSfvoUeu92gf9" } I traced this back to Content Create-persona [image] And the error seems to be this part: [image] because when I removed it (which wasn’t possible on this specific persona) by doing a clone and setting this setting to my clone [image] Semantic search started to work. I needed to do a similar thing in e.g. my summarizer. Is this something you guys experienced as well?

Can you show how Sonnet 5 is configured on your instance? Do you have Disable native structured output (use assistant message prefilling instead, required for Claude 3.x and older) enabled by any chance?

[image] Falco: Can you show how Sonnet 5 is configured on your instance? Do you have Disable native structured output (use assistant message prefilling instead, required for Claude 3.x and older) enabled by any chance? The forum in question is running 2026.1.5 ESR, and this option was added after 2026.1, so I guess a lot of Claude specific logic is missing there.

Oh, thanks for sharing! Trying to use a new model with an old Discourse is not a winning strategy :smiley:. The providers keep changing API formats, parameters, etc. We do the best to keep the compatibility with thousands of models, but that does require constant updates to keep up, specially if you want to keep up with models launched half a year (centuries in AI years) than the Discourse version.

Discourse AI: Need to Remove JSON Response to get Antrophic Sonnet 5-working in e.g. semantic search

Product Support

RGJ (Richard - Communiteq) July 9, 2026, 1:28pm 3

The forum in question is running 2026.1.5 ESR, and this option was added after 2026.1, so I guess a lot of Claude specific logic is missing there.

Topic		Replies	Views
Error using Claude 3.7 Sonnet with Discourse AI plugin Bug ai , ai-bot	10	1781	March 5, 2025
Adding Semantic Search feature for our self-hosted discourse site Product Support ai , ai-search	9	501	March 19, 2025
Claude 3.5 Sonnet in Discourse AI? Product Support ai	11	776	July 4, 2024
Discourse AI - Semantic Search & Summarization Not Working for our configuration Product Support ai , ai-summarize	5	429	September 17, 2025
Discourse now supports Open AI responses API Announcements ai	0	233	June 11, 2025

Discourse AI: Need to Remove JSON Response to get Antrophic Sonnet 5-working in e.g. semantic search

Related topics