I have a question regarding the AI plugin. Currently, I only see OpenAI as an option. Is it possible for us to use a local model, such as Ollama, or another program that lets us host our own models? This would help us save on costs since the tokens would be free.
Yes, the plugin is completely provider agnostic, you may use it with a local LLM out of the box.
3 Likes