Shouldn't AI be able to read Summaries and other detailed content?

It sounds like a matter of better engineering the system prompt and providing examples of tool use. Could you share the system prompt you currently have for your persona? I’d be happy to help you improve it!

I run 4o-mini in an educational bot and it’s flawless so 4o should be more than sufficient for what you need with good prompting!