Ai:embeddings:backfill - Handling OpenAI's 400 Error for Excessive Tokens in Embeddings

Thank you for your guidance. I think I found one hell of an edge case.

The problem was Zalgo text

That is, this stuff:

This hello world becomes 607 characters with all the junk on it

There was a post with a bunch of it so I deleted it. The backfill was able to proceed. Probably not a high priority issue but I can’t be the only one with a post like this on their forum.