We have many topics that exceed typical context lengths (say 128k) and bad things happen. Have you considered summarizing based on only the most-liked posts? Start with the most-liked post, add the next-most-liked, and continue until the target context length is reached, then pass the resulting text…

That is how it works on long topics, we use the top 50 most liked posts in the topic.

Hmm, summarizing appears to hang on long topics, so I assumed it was related to the content length. Any tips for debugging this? I’m using gpt-o4. I don’t see a way to view specific API requests in my OpenAI dashboard.

You can see requests on the ai_api_audit_logs table. Regarding the hanging mid summarization, we had some front end bugs on that front recently, so please update your site to latest.

I found this in the error logs: Request too large for gpt-4o in organization org-xxxxxxxxxxxxxxxxx on tokens per min (TPM): Limit 30000, Requested 45906. To increase my limits, I believe I have to actually spend $50 (not just budget it) and wait something like a month plus 7 days: [image] So fa…

Ohhh so the issue is that you have a restricted OpenAI account that limits you on tokens per minute, which impact using AI summarization on Discourse. That’s is such a bummer. I’d look into alternative providers, like Antrhopic, AWS, Azure, Google Cloud or even Llama API providers. I believe there …

I switched from using 4o to 4o-mini for summarization, and that appears to work on my longest topics. Apparently OpenAI has different limits for the different GPTs.

为什么我的论坛总结总是卡住？

支持

Falco (Falco) 2024年十月25日 01:17 4

您可以在 ai_api_audit_logs 表中查看请求。

关于摘要中断的问题，我们最近在此方面遇到了一些前端 bug，请将您的站点更新到最新版本。

話題		回覆	觀看
Summarising topics with an LLM (GPT, BERT, ...)? Feature	11	4201	2023年十一月22日
Configuring Discourse AI for Summarization Support ai , ai-summarize	6	303	2024年七月23日
Topic Summarization doesn't work :-( Support ai , ai-summarize	8	368	2025年六月4日
Summarize large topics by default Feature	2	1876	2017年五月5日
AI summarization not working after upgrading to 3.3.0 beta1 Support ai	10	910	2024年三月20日

为什么我的论坛总结总是卡住？

相關主題