Getting a lot of no results for semantic search

Ohhhhh I see. This won’t work in this case.

The way our current AI search works it:

  • Takes user input
  • Creates a new post about it taking into account the forum description
  • Returns the most semantically similar topics to it

There is no threshold of distance where we cut off the search, as finding out a general threshold that covers all thousands of Discourse instances is non-trivial. This is discussed at Setting a similarity threshold for semantic search.

We are looking into releasing a new approach that will do a more standard LLM + RAG search and return a conversational response, where you can tweak the prompt to say “no results found”. This is coming in the next weeks, will ping you here when you can test it.

1 Like