I would recommend the following approach:
- Process the 10 files using a “Creative” persona using a large context / large output LLM like Sonnet 4 thinking. The goal of this processing would be to “tidy” up the information and prepare it for a RAG
- Then using our built in upload, upload the 10 processed files to a persona, so RAG can search through the content.
Given there is tons of data here I recommend against stuffing a system prompt. As a guideline a system prompt should not be super long, it becomes costly. 10k tokens is workable, 100k tokens is not workable with current frontier LLMs. Every interaction will cost you too much and the LLMs would get extra confused.
Let us know how you go!
Please share the prompts you used to shrink / tidy the chat logs.