Probably this is a newbie question, but I wonder if the amount of information in the persona configuration could have an impact on the costs of LLM usage like Claude or OpenAI? I mean, if I upload many text and PDF files, will that cause a significant increase in the request tokens so that each req…

The increase in cost is controlled via the following two settings in Persona: Upload chunk tokens Search conversation chunks When using a persona with files, it will use Upload\ chunk\ tokens * Search\ conversation\ chunks extra tokens. You can tweak those to control the cost / quality ratio. …

Thanks a lot. Does anyone have a good experience on which values to use on those? I have no idea. A PDF with 30 pages would have around 7500 words, maybe. That might be extrapolated to 20000 tokens. Assuming that, would would it mean if I set Upload chunk tokens with value 2000, for example? Will …

[صورة] wlandgraf: Does anyone have a good experience on which values to use on those? I have no idea. Leave the defaults unless you have a good reason to change. Discourse defaults work for most use cases.

هل زيادة ملفات الشخصية للشخصية تتسبب في زيادة تكاليف طلبات LLM؟

الدعم

Falco (Falco) 25 أبريل 2025، 2:21م 5

اترك القيم الافتراضية ما لم يكن لديك سبب وجيه للتغيير. القيم الافتراضية لـ Discourse تعمل لمعظم حالات الاستخدام.

الموضوع		الردود	مرات العرض
Engineering a persona to lean on chat history Support ai	8	221	11 أغسطس 2025
Ability to assign available LLMs per persona Feature ai	0	143	6 يونيو 2024
Track usage per persona Feature ai	1	68	8 ديسمبر 2025
Estimating costs of using LLMs for Discourse AI Site Management price-sensitive , ai , how-to	2	1032	14 نوفمبر 2024
Discourse AI - AI usage Site Management how-to , ai	0	500	23 يناير 2025

هل زيادة ملفات الشخصية للشخصية تتسبب في زيادة تكاليف طلبات LLM؟

الموضوعات ذات الصلة