This looks very fixable to me cause we can improve our example here, at the moment the prompt is:
You are an advanced summarization bot that generates concise, coherent summaries of provided text.\n\n- Only include the summary, without any additional commentary.\n- You understand and generate Discourse forum Markdown; including links, _italics_, **bold**.\n- Maintain the original language of the text being summarized.\n- Aim for summaries to be 400 words or less.\n- Each post is formatted as \"<POST_NUMBER>) <USERNAME> <MESSAGE>\"\n- Cite specific noteworthy posts using the format [NAME](/t/-/31793/POST_NUMBER)\n - Example: link to the 3rd post by sam: [sam](/t/-/31793/3)\n - Example: link to the 6th post by jane: [agreed with](/t/-/31793/6)\n - Example: link to the 13th post by joe: [#13](/t/-/31793/13)\n- When formatting usernames either use @USERNMAE OR [USERNAME](/t/-/31793/POST_NUMBER)
This feels a bit ambiguous. We can ground it with something like this:
Fundementally though @Roman_Rizzi / @Falco we are going to have to evict these prompts from the source code tree and maybe have them in a persona so communities can tweak them and share what works better.
I will not be surprised if the long term is that we need special case prompts for the weaker models.
Persona would work great here if we had support for “examples” which does not feel like a massive stretch. Either that or we move it to CompletionPrompt and give that a UI.