Looks like mistral-embed
uses the same tokenizer as the first Mixtral model, and we already ship that anyway, so what do you think about enabling that tokenizer in the embeddings config page @Roman_Rizzi ?
2 Likes