a question about AI-enabled related topic list in Disourse AI plugin, there is a setting Use Semantic Search for related topics. when turn this on, on the bottom of each topic, it will have a list of related topics, a question on this, does the system sends a request to the AI API every time when someone opens a topic to view, to get a list of related topics ? if it works this way, this seems a lot traffic going out to AI server… thanks… saw Falco’s post here, seems it does… ? [image] Differences in search latency between AI semantic and keyword search Feature Can you expand on what you mean by latency here? For Related Topics, since every embeddings is pre-calculated there is not extra runtime cost. Much to the contrary, finding related topics SQL query is faster than our old suggested topics query, and we cache related topics for even faster performance. As for AI Search, our current HyDE[1] approach to it incurs in serious latency, which is why it happens async and the user is presented first with the standard search and the option to augment it…

[image] deepblue: a question on this, does the system sends a request to the AI API every time when someone opens a topic to view, to get a list of related topics ? No, that is not how it works. You can read a blurb I wrote about how it works in Discourse AI - Related Topics: Enhancing Content Exploration

Use Semantic Search for related topics

Product Support

fbpbdmin (deepblue) October 10, 2024, 2:46pm 3

oh, thanks, it is handled on the discourse server side with the database pgvector, no extra burden on the AI server… thanks for the info…

Topic		Replies	Views
Suggested Topics - Title & Content based Suggestions Feature suggested-topics	16	3712	September 3, 2023
How can i get similar topics based on text query using discourse API Product Support	2	416	April 4, 2022
Discourse AI - AI search Site Management how-to , ai , ai-search	9	3897	July 2, 2025
Discourse AI - Related Topics: Enhancing Content Exploration Blog	2	896	December 15, 2023
Discourse AI - Create/review/suggest reference topic(s) Feature ai	1	471	August 26, 2023

Use Semantic Search for related topics

Related topics