Summarising topics with an LLM (GPT, BERT, ...)?

[mikessmt (mike)]

@sam

Summarization is particularly interesting, we are buying a few A100 servers and should have them racked up in the next few weeks. Mistral is surprisingly capable and fast, once we have the capacity rolled out we may be able to provide summary even to business plans without byo keys, but we need to first explore perf characteristics prior to making any commitments there.

Thank you, Sam. We would be very interested in this feature, and I suspect other hosting customers would as well. All the best.