What settings do you recommend tweaking or increasing to reduce response time? Assume I’m only talking about a single conversation, not dozens running at the same time. Aside from trimming down the prompt/RAG, it seems like Thinking Effort is the only setting that really affects timing for an individual conversation.
For background, I have an agent equipped with GPT Sol 6.1 and loaded with our product documentation, knowledge base articles, and some “gotcha” questions and answers.
I just noticed a subagent setting. I wonder if I can use this to split up some product versions/components and streamline the RAG?