Summarising topics with an LLM (GPT, BERT, ...)?

@Julienlavigne I’ve made some significant improvements to this in terms of stability, flexibility and administrative feedback.

Errors returned by the model are now logged, for example, so you can now easily tell if you’ve breached model limits.

If you (or anyone) wants to give it a try I might be able to provide a little casual support for it for a little while and may be able to incorporate feedback where reasonable.

The full set of settings is now:

5 Likes