Search a term in Japanese

I don’t use Ruby these days nor don’t know the requirement from Discourse but there seems to be a gem for “mecab”.

I came to this topic because I found that searching some words doesn’t work on my hosted public instance. I have

  • min search term length: 1
  • search tokenize chinese japanese korean: enabled
  • default locale: Japanese

IIRC, I’ve initialized the site with English locale and changed the setting to Japanese later.

The words I found failed to search are “北側”, “真上”, “一般”. These words are in this topic. Many words work but these don’t. I don’t see any pattern whether a word works or not.

Is there a way to check the generated search index on the hosted instance? I can read both Ruby and Japanese so if there is a way to see how Discourse generate search index for CJK, I might be some help.

CppjiebaRb, or cppjieba, mentioned by @tgxworld seems to be for Chinese. Is it used for Japanese locale?