Quick question what would be a “better” structure for our use case: We have a bunch of exported chat history logs from Slack Channels which contains a lot of know-how, mentioned problems and solutions, etc. Obviously those chats contain a lot of useless “fluff” that would unecomical to just dump in…

I would recommend the following approach: Process the 10 files using a “Creative” persona using a large context / large output LLM like Sonnet 4 thinking. The goal of this processing would be to “tidy” up the information and prepare it for a RAG Then using our built in upload, upload the 10 proces…

Thx, that helps! [صورة] sam: 10k tokens is workable Just to clarify, are all the uploaded files injected into the system prompt? Or are they processed through the configured ai_embeddings_model first and then injected? I am a bit confused about your recommended 10k token limit recommendatio…

The files in Discourse AI Persona, upload support are only limited by your upload size, they can be huge, they are processed via embedding, we inject chunks into the prompt per configuration. What I was talking about was trying to coerce all the information into a single system prompt here: [imag…

Ah, that clears is it up, thanks! So basically, my next steps should be to run a few tests with different embeddings models and see what token size I end up injected into the system prompt, right? And when creating those txt files with chunks, I should make sure that they stay within a reasonable …

[صورة] jrgong: So basically, my next steps should be to run a few tests with different embeddings models and see what token size I end up injected into the system prompt, right? The embedding model controls quality, not quantity you can roll up all your data into a single file, we will chunk…

Thx sam, I really appreciate it :heart: If you have any further helpful resources, feel free to share them here. Once I make progress, I will try and publish my experience here on meta. :slight_smile:

@sam how do you suggest adding version or model numbers to metadata separators? Your original example : [[metadata about cats]] a long story about cats [[metadata about dogs]] a long story about dogs Now if we want to enrich them with version numbers or specific model numbers, do I just use the sa…

[صورة] jrgong: do I just use the same format or structure that humans would use when typing them? Yes, this is the way to go!

هندسة شخصية للاعتماد على سجل الدردشة

الدعم

sam (Sam Saffron) 11 أغسطس 2025، 10:59م 9

نعم، هذه هي الطريقة الصحيحة!

إعجابَين (2)

الموضوع		الردود	مرات العرض
Discourse AI Persona, upload support Announcements ai-bot , ai	21	1636	11 سبتمبر 2025
AI bot - Chat and PM integration Site Management how-to , ai-bot , chat , ai	8	1126	24 أكتوبر 2024
Creating custom AI Bot personas Feature ai-bot , ai , completed	12	3680	23 نوفمبر 2023
[Ai Bot] Add user token tracking, custom AI personas, max context posts, document loading, custom API URLs, and localized chat titles Feature ai-bot , ai	2	543	22 مارس 2024
AI personas integration of the chat plugin: It would be great if site users could chat with AI personas Feature ai , chat , completed	7	977	11 مايو 2024

هندسة شخصية للاعتماد على سجل الدردشة

الموضوعات ذات الصلة