I’ve been looking at search recently and noticed that it’s not all that useful on the forum I self-host, even when I search the exact title of the topic, leading me to believe that it might not be working properly on my forum. I also decided to try out semantic search to see how its results compare.
Here I use normal search but the topic I’m looking for does not show in the results:
To compare, I also tried semantic search (here the target topic I’m looking for is 3rd):
Unfortunately, if my search is less exact the results are completely different (I’m unclear how any of those topics relate to the search query):
how to appeal my ban shows similar results to
how to appeal your ban at least)
Information That May Be Relevant
Discourse version installed (updated forum around 12 hours ago):
3.1.0.beta4 ( b46899e5fa)
Settings for semantic search:
Hidden site setting for search:
I also ran
rake search:reindex to be sure the index was updated, same results.
Try yourself here:
Search results for '' - Dark Gaming
Is there an issue with my normal search? Should it really not find the topic when I search using the exact title?
Is it expected that semantic search performs as above, where a slightly less exact query finds completely irrelevant topics? (I clicked on one of those topics and found no mention of
May 4, 2023, 1:10pm
Just throwing this out: have you tried putting quotes around your search query?
“how to appeal your ban”
Should find only the instances of those particular words in that order.
That does help to find an exact match. It limits the results to 9 in total, which contains the right topic (though the target topic is still not first). However, I’m not so sure that new users will be using quotes in their searches, nor will know exactly the title.
Mainly just wondering if the behaviour in the OP is expected at the moment or whether there’s something broken with my installation.
how to appeal your ban
Relavancy varies based on what you type in.
(Note - try changing your search results, as this may affect the results.)
(Edited due to not helping with situation)
appropos of nothing, i have to giggle at the topic of “how to appeal your ban”
The site is often used to appeal bans which is why “how to appeal ban” is being showcased.
Example topics can be found here:
(link failed so edit)
oh i see, a ban not related to being suspended from the forum. that makes more sense now.
aha Discord bans DOH i should have guessed. i like your forum btw.
we’re not running the AI yet but i’m curious about how it’s working with the searches.
It picks the search results using semantic-related queries like this:
This powers two modules at the moment:
Semantic Related Topics
When you get to the end of a topic, Discourse presents you with 5 suggestions of topics to read next. Nowadays, we pick 5 random topics for anonymous users and use the unread topics for logged-in users to populate that list, making it quick to generate but not very useful when you are researching a specific subject.
With the new Semantic Related Topics feature, we will use Semantic Textual Similarity between the current topic and all the other topics in your instance to suggest topics that are potentially more relevant to what a person is looking for.
This is enabled here on Meta for all, including anon Semantic Search
This used the same logic we used for semantic related topics, but to power search results.
More on this soon.