Arabic Search Normalization: Missing Support for Hamza Variants, Ya/Kaf Forms,and Orthographic Equivalence

[supermathie (Michael Brown)]

@serkhelesheyi

Preprocessing both indexed content and user queries to unify character variants.

For this part of the problem, we’re talking about a Unicode standard NFKC (to pick one) normalisation?

(I’m not even sure what we do… I assume we normalise post text in the cooking pipeline?)