Oh. Uh. . .
Yeah. That’s what I’m wanting.
My use case is to create course assignments (like the helpful tutor) that guide people through some AI-generated activity. Discourse is my hammer, so I want everything to be in Discourse. (I spent like 12 hours this weekend finding and installing a URL shortener/QR code generator–I think I could have done it faster as a Discourse plugin!).
Looking at what I and my students have been paying for API calls, it looks much cheaper to have Discourse as a way to use GPT4 than to pay $20/month to use their interface.
If anyone else is listening, I think he means this: What is retrieval-augmented generation (RAG)? - IBM Research.
Oh, sorry. Yeah, I’m far afield from that.