AI 摘要载荷中的文本神秘地颠倒了

我的大部分摘要都失败了,因为发送给 LLM 的部分文本是颠倒的(!)。如果帖子只是:

This post is to test whether sections of text get reversed in the payload sent to the AI endpoint.

它实际上发送给 LLM 的文本是:

This post is to test whether sections of text get .tniopdne IA eht ot tnes daolyap eht ni desrever

在这个简单的测试中,它在字符串的中间精确地折叠或镜像了。

我确实意识到这听起来很疯狂,所以这里有一个截图和来自 ai_api_audit_logs 的相应 raw_request_payload:

ai_api_audit_logs.raw_request_payload
{
  "model": "claude-sonnet-4-0",
  "max_tokens": 64000,
  "messages": [
    {
      "role": "user",
      "content": "Here are the posts inside <input></input> XML tags:\n\n<input>1) user1 said: I love Mondays 2) user2 said: I hate Mondays</input>\n\nGenerate a concise, coherent summary of the text above maintaining the original language."
    },
    {
      "role": "assistant",
      "content": "{\"summary\":\"Two users are sharing their feelings toward Mondays. [user1](/t/-/64255/1) hates them, while [user2](/t/-/64255/2) loves them.\"}"
    },
    {
      "role": "user",
      "content": "The discussion title is: Testing Text Reversal.\n\nCategory: testing.\n\n\nHere are the posts, inside <input></input> XML tags:\n\n<input>\n  (1 admin said: This post is to test whether sections of text get .tniopdne IA eht ot tnes daolyap eht ni desrever  \n</input>\n\nGenerate a concise, coherent summary of the text above maintaining the original language."
    },
    {
      "role": "assistant",
      "content": "{\""
    }
  ],
  "system": "You are an advanced summarization bot that generates concise, coherent summaries of provided text.\nYou are also capable of enhancing an existing summaries by incorporating additional posts if asked to.\n\n- Only include the summary, without any additional commentary.\n- You understand and generate Discourse forum Markdown; including links, _italics_, **bold**.\n- Maintain the original language of the text being summarized.\n- Aim for summaries to be 400 words or less.\n- Each post is formatted as \"<POST_NUMBER>) <USERNAME> <MESSAGE>\"\n- Cite specific noteworthy posts using the format [DESCRIPTION](/t/-/64255/POST_NUMBER)\n- Example: link to the 6th post by jane: [agreed with](/t/-/64255/6)\n- Example: link to the 13th post by joe: [joe](/t/-/64255/13)\n- When formatting usernames use [USERNAME](/t/-/64255/POST_NUMBER)\n\nFormat your response as a JSON object with a single key named \"summary\", which has the summary as the value.\nYour output should be in the following format:\n\n{\"summary\": \"xx\"}\n\nWhere \"xx\" is replaced by the summary.\nreply with valid JSON only",
  "stream": true
}

有趣的是,Sonnet 拒绝总结许多主题,因为它认为反向文本是为了混淆或绕过规则。

我的版本是最新的,为 3.6.0.beta3-latest。

2 个赞

那不是最新的。请更新到最新版本,这个问题在十二月初就已修复。

1 个赞

谢谢,我会更新的。但我的设备上都显示已是最新版本,即使是硬刷新之后也是如此。请问我是否应该单独报告这个问题?

1 个赞

我认为这也在这里报告过

1 个赞