The discussion revolves around the Use Semantic Search for related topics feature in the Discourse AI plugin. fbpbdmin asks whether the system sends a request to the AI API every time a topic is opened, expressing concern about potential traffic to the AI server. Falco clarifies that this is not the case, explaining that the feature operates on the Discourse server side using the database and pgvector, eliminating the need for real-time API calls. fbpbdmin appreciates the clarification, noting that this approach avoids extra load on the AI server.
a question about AI-enabled related topic list
in Disourse AI plugin, there is a setting
Use Semantic Search for related topics.
when turn this on, on the bottom of each topic, it will have a list of related topics,
a question on this, does the system sends a request to the AI API every time when someone opens a topic to view, to get a list of related topics ?
if it works this way, this seems a lot traffic going out to AI server…
thanks…
saw Falco’s post here, seems it does… ?
No, that is not how it works.
You can read a blurb I wrote about how it works in Discourse AI - Related Topics: Enhancing Content Exploration
oh, thanks, it is handled on the discourse server side with the database pgvector, no extra burden on the AI server… thanks for the info…