That is correct. We will probably get to wider integration, but are taking our time here and trying to polish the existing stuff first.
Yes, this is the very frustrating thing about GPT 3.5 vs 4. Grounding the model for 3.5 is just super duper hard.
I am considering having an intermediary step prior to replying in GPT 3.5 that first triages prior to actually responding (Eg: does this interaction INTERACTION look like it should result in a !command, if so which?) It would sadly add cost and delay so this is my last resort
We use a “sort of” langchain, limited to 5 steps, but we try to be very frugal with tokens so balance is hard.
Up to you… I like having access to all of Google, it is mighty handy