Self-Hosting Embeddings for DiscourseAI

Okay, I finally have an endpoint to use for embeddings :slight_smile:

While self-hosting, how to properly add the `gems` that official plugin don’t enable?

I see on logs that `parallel` and `ruby-progressbar` are missing and that prevent the `rake ai:embeddings:backfill`.

You don’t have to run the rake task, Discourse will automatically backfill now.

If you have a large backlog of topics, you can increase the value of the hidden setting ai_embeddings_backfill_batch_size to make as fast as your endpoint can handle.

3 Likes