Enabling AI search crippled my server

I enabled “AI embeddings enabled” last night and the backfill was happening in the background. Today I enabled “AI embeddings semantic search enabled” and the CPU shot upto 100 constantly with a huge LOW queue sidekiq backlog. Search stopped working completely on the server.

I disabled the semantic search and the server went back down to normal CPU within minutes with all the queue cleared.

So is there a way to do this differently or is this expected?

1 Like