Our current plan is to tell the LLM to keep the summary in the same language as the posts who were summarized. That is still not the case, but we may be able to get to it next week. We’ve been hard at work on summarization:
- Support for Open Source LLMs like Llama2, StableBeluga2, etc.
- Support for summary streaming
- Handling LLM API timeouts
So keep an eye on news here soon.