# Thai language support for searching

**URL:** <https://meta.discourse.org/t/thai-language-support-for-searching/53635>\
**Category:** Bug\
**Created:** [1 december 2016 om 15:46 UTC](https://meta.discourse.org/t/thai-language-support-for-searching/53635 "2016-12-01T15:46:57Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![sujato](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sujato/32/114616_2.png) [@sujato](https://meta.discourse.org/u/sujato)\
**Post date:** [3 december 2016 om 10:08 UTC](https://meta.discourse.org/t/thai-language-support-for-searching/53635/4 "2016-12-03T10:08:01Z")

</div>

With CJK languages, each character is (more or less) a word. But in Thai several characters combine to produce a syllable, where the vowel may be before, after, above, or below, the consonant, and various tone markers may also be added. To make it even funner, words are usually (but not always) one syllable and there is usually no space between words. There must be standard libraries to tokenize these for search, I’m guessing.

Incidentally, most of the south and south-east Asian languages use related scripts, so if Thai has these problems we may find other languages do too.

---

_[View the full topic](https://meta.discourse.org/t/thai-language-support-for-searching/53635)._
