Can Discourse AI Plugin Connect with OpenAI Assistants?

I believe he’s referring to Open AI’s somewhat controversial conversational API.

https://platform.openai.com/docs/api-reference/assistants

Controversial because it has a reputation for being expensive (the algorithm apparently fills its maximum context every cycle which with GPT 4 selected especially will really start to rapidly increase your bill - currently ~$1 per call! - It’s not for the cost sensitive!) and something you can solve using local RAG and train of thought in more controlled and efficient way using standard chat completion endpoints.

Advantages are its simplicity, separating of concerns and the fact it can handle several upload formats out of the box (though you have to pay for storage.)

It doesn’t offer the user significantly more than we already have with both Chatbot and AI Bot afaict, would in some ways just provide a technical simplification and the cost inefficiency is a real concern.

I held off from adding this to Chatbot due to the negative feedback from some of the Open AI community.

Perhaps they will address its issues at some point and it will become a more attractive option …

4 Likes