I don’t use Ruby these days nor don’t know the requirement from Discourse but there seems to be a gem for “mecab”.
I came to this topic because I found that searching some words doesn’t work on my hosted public instance. I have
- min search term length: 1
- search tokenize chinese japanese korean: enabled
- default locale: Japanese
IIRC, I’ve initialized the site with English locale and changed the setting to Japanese later.
The words I found failed to search are “北側”, “真上”, “一般”. These words are in this topic. Many words work but these don’t. I don’t see any pattern whether a word works or not.
Is there a way to check the generated search index on the hosted instance? I can read both Ruby and Japanese so if there is a way to see how Discourse generate search index for CJK, I might be some help.
CppjiebaRb, or cppjieba, mentioned by @tgxworld seems to be for Chinese. Is it used for Japanese locale?