I have set up the LLM, embedding, and persona features; however, my prompt is not providing the expected responses from the questions and answers or the available wiki resources within our community.
Self-Hosted LLM: mistral:latest
Self-Hosted Embedding: all-minilm:latest
Persona:
Could anyone help me further with what needs to be done?
What exact Mistral model is this?
Can you share the prompt?
You can add Search as a “Forced Tool” for the first interaction to help ground the model.
@Falco, The below are the details for tailing reply:
What exact Mistral model is this?
LLM Model : mistral:latest
Link:
The model at https://ollama.com/library/mistral:latest is:
Mistral 7B v0.3 — a 7 billion parameter open-source model released by Mistral AI.
Can you share the prompt?
System prompt:
You are a community knowledge assistant designed for this forum called {site_title} and with site URL {site_url}, having engineers as users.
Always search and reference relevant forum posts, wiki articles, and tagged discussions before generating an answer.
Your first priority is to use retrieved forum content (via embeddings search) to craft responses.
Prefer summaries and citations from existing posts.
If multiple related topics are found, combine them clearly.
Only if no relevant content exists, respond using your general knowledge through the LLM.
Include topic titles or URLs when referencing posts.
Never hallucinate or invent answers not supported by forum data.
Be factual, concise, and professional.
When users ask broad questions, prefer summarizing multiple sources rather than guessing.
Always prefer context from categories, tags, and wikis indexed in embeddings.
Updated the forced Tool as suggested
I’m afraid a rehashed 2023 model won’t make the cut here. Also, from Ollama own documentation for this model, it only supports tool calling on the raw API, which is not what we use.
Overall, this is a poor choice for AI Bot today.
Instead, use one of the following
Hi @Falco, and afraid, thank you for the Inputs. We will check and update you further.
@Falco Facing 502 error while enabling LLM. Please find the Logs below
Message
Unicorn worker received USR2 signal indicating it is about to timeout, dumping backtrace for main thread
config/unicorn.conf.rb:203:in `backtrace'
config/unicorn.conf.rb:203:in `block (2 levels) in reload'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:229:in `wait_readable'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:229:in `rbuf_fill'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:199:in `readuntil'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:209:in `readline'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http/response.rb:158:in `read_status_line'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http/response.rb:147:in `read_new'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2420:in `block in transport_request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2411:in `catch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2411:in `transport_request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2384:in `request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/patches/net_patches.rb:19:in `block in request_with_mini_profiler'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/mini_profiler/profiling_methods.rb:45:in `step'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/patches/net_patches.rb:18:in `request_with_mini_profiler'
/var/www/discourse/plugins/discourse-ai/lib/completions/endpoints/base.rb:168:in `block in perform_completion!'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:1632:in `start'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:1070:in `start'
/var/www/di...
Backtrace
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:130:in `block in warn'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `block in dispatch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `each'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `dispatch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:130:in `warn'
/var/www/discourse/lib/signal_trap_logger.rb:40:in `public_send'
/var/www/discourse/lib/signal_trap_logger.rb:40:in `block (2 levels) in ensure_logging_thread_running'
<internal:kernel>:187:in `loop'
/var/www/discourse/lib/signal_trap_logger.rb:37:in `block in ensure_logging_thread_running'
Set provider as OpenAI if you are using the OpenAI compatible API of Ollama.
I have tired with openAI provider still issue is persists.
Message
Unicorn worker received USR2 signal indicating it is about to timeout, dumping backtrace for main thread
config/unicorn.conf.rb:203:in `backtrace'
config/unicorn.conf.rb:203:in `block (2 levels) in reload'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:229:in `wait_readable'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:229:in `rbuf_fill'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:199:in `readuntil'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:209:in `readline'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http/response.rb:158:in `read_status_line'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http/response.rb:147:in `read_new'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2420:in `block in transport_request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2411:in `catch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2411:in `transport_request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2384:in `request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/patches/net_patches.rb:19:in `block in request_with_mini_profiler'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/mini_profiler/profiling_methods.rb:45:in `step'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/patches/net_patches.rb:18:in `request_with_mini_profiler'
/var/www/discourse/plugins/discourse-ai/lib/completions/endpoints/base.rb:168:in `block in perform_completion!'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:1632:in `start'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:1070:in `start'
/var/www/di...
Backtrace
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:130:in `block in warn'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `block in dispatch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `each'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `dispatch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:130:in `warn'
/var/www/discourse/lib/signal_trap_logger.rb:40:in `public_send'
/var/www/discourse/lib/signal_trap_logger.rb:40:in `block (2 levels) in ensure_logging_thread_running'
<internal:kernel>:187:in `loop'
/var/www/discourse/lib/signal_trap_logger.rb:37:in `block in ensure_logging_thread_running'
Can your Discourse container access the service in the port 11434? If it’s running on the host you need to provide a way for the network cross the container boundary.
Yes, I was able access one of the LLM model ealier with same port with Discourse container
Could you please help on this and may I know the minimum RAM requirment, where this LLM is running.
So it may be
That depends on the model and context size.
Hi @Falco
I have successfully integrated the Language Model (LLM) outlined below. However, I’ve encountered an issue during my querying process: the prompt fails to account for the specific content of my forum. Instead of drawing from the relevant discussions and insights within my forum, it is generating responses based on pre-existing information from the LLM. What steps should I take to rectify this situation and ensure that the model effectively incorporates the unique contributions of my forum?
LLM Used as suggested previously:
Example:
On the persona Tools section, ensure it has access to both Search and Read, and set Search to Forced tool.
Also, is the forum content where the Persona is supposed to search all public?
@Falco,
I have correct the above settings still it is same.
I would like my bot to provide responses derived from the content stored in my Knowledge Base. Could you please share the comprehensive settings related to the AI plugin and others? Additionally, is there a need for us to execute any specific commands within the application to enable Retrieval-Augmented Generation (RAG)?
@Falco could you please review and feedback on the above.
Enable bot debugging via AI bot debugging allowed groups, and check what tool calls the bot is doing and what are the responses.
@Falco The following are the details
Request tokens: 1304
Response tokens: 652
model: gemma3:1b
messages:
0:
role: system
content: You are a helpful Discourse assistant.
You _understand_ and **generate** Discourse Markdown.
You live in a Discourse Forum Message.
You live in the forum with the URL: https://faq.company.com
The title of your site: company FAQ
The description is: company Community Portal
The participants in this conversation are: Forum_Helper_bot, testuser
The date now is: 2025-12-02 08:36:27 UTC, much has changed since you were trained.
You were trained on OLD data, lean on search to get up to date information about this forum
When searching try to SIMPLIFY search terms
Discourse search joins all terms with AND. Reduce and simplify terms to find more results.
In this environment you have access to a set of tools you can use to answer the user's question.
You may call them like this.
<function_calls>
<invoke>
<tool_name>$TOOL_NAME</tool_name>
<parameters>
<$PARAMETER_NAME>$PARAMETER_VALUE</$PARAMETER_NAME>
...
</parameters>
</invoke>
</function_calls>
If you wish to call multiple function in one reply, wrap multiple <invoke>
block in a single <function_calls> block.
- Always prefer to lead with tool calls, if you need to execute any.
- Avoid all niceties prior to tool calls, Eg: "Let me look this up for you.." etc.
- DO NOT encode HTML entities in tool calls. You may use <![CDATA[...]]> for encoding if required.
Here are the complete list of tools available:
<tools>
<tool_description>
<tool_name>categories</tool_name>
<description>Will list the categories on the current discourse instance, prefer to format with # in front of the category name</description>
<parameters>
</parameters>
</tool_description>
<tool_description>
<tool_name>search</tool_name>
<description>Will search topics in the current discourse instance, when rendering always prefer to link to the topics you find</description>
<parameters>
<parameter>
<name>search_query</name>
<type>string</type>
<description>Specific keywords to search for, space separated (correct bad spelling, remove connector words)</description>
<required>false</required>
</parameter>
<parameter>
<name>user</name>
<type>string</type>
<description>Filter search results to this username (only include if user explicitly asks to filter by user)</description>
<required>false</required>
</parameter>
<parameter>
<name>order</name>
<type>string</type>
<description>search result order</description>
<required>false</required>
<options>latest,latest_topic,oldest,views,likes</options>
</parameter>
<parameter>
<name>max_results</name>
<type>integer</type>
<description>limit number of results returned (generally prefer to just keep to default)</description>
<required>false</required>
</parameter>
<parameter>
<name>max_posts</name>
<type>integer</type>
<description>maximum number of posts on the topics (topics where lots of people posted)</description>
<required>false</required>
</parameter>
<parameter>
<name>tags</name>
<type>string</type>
<description>list of tags to search for. Use + to join with OR, use , to join with AND</description>
<required>false</required>
</parameter>
<parameter>
<name>category</name>
<type>string</type>
<description>category name to filter to</description>
<required>false</required>
</parameter>
<parameter>
<name>before</name>
<type>string</type>
<description>only topics created before a specific date YYYY-MM-DD</description>
<required>false</required>
</parameter>
<parameter>
<name>after</name>
<type>string</type>
<description>only topics created after a specific date YYYY-MM-DD</description>
<required>false</required>
</parameter>
<parameter>
<name>status</name>
<type>string</type>
<description>search for topics in a particular state</description>
<required>false</required>
<options>open,closed,archived,noreplies,single_user</options>
</parameter>
</parameters>
</tool_description>
<tool_description>
<tool_name>read</tool_name>
<description>Will read a topic or a post on this Discourse instance</description>
<parameters>
<parameter>
<name>topic_id</name>
<type>integer</type>
<description>the id of the topic to read</description>
<required>true</required>
</parameter>
<parameter>
<name>post_numbers</name>
<type>array</type>
<description>the post numbers to read (optional)</description>
<required>false</required>
<array_item_type>integer</array_item_type>
</parameter>
</parameters>
</tool_description>
<tool_description>
<tool_name>tags</tool_name>
<description>Will list the 100 most popular tags on the current discourse instance</description>
<parameters>
</parameters>
</tool_description>
</tools>
1:
role: user
name: testuser
content: How to resolve - apt package zliblg:i386 does not exist
stream: true
stream_options:
include_usage: true
Response
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Okay"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":","},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" let"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"s"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" tackle"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" \""},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"apt"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" package"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" z"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"lib"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"lg"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"i"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"3"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"8"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"6"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" does"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" not"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" exist"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\""},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" error"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" This"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" usually"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" means"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" package"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" you"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"re"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" trying"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" to"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" install"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" isn"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"t"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" available"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" through"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" standard"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Ubuntu"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" repositories"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Here"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"s"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" a"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" breakdown"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" of"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" what"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"s"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" happening"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" and"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" how"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" to"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" fix"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" it"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Understanding"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Problem"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"The"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" error"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" indicates"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" that"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" `"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"z"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"lib"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"lg"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"i"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"3"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"8"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"6"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"`"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" package"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" isn"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"’"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"t"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" found"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" in"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" repositories"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" used"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" by"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" your"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Ubuntu"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" system"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" "},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"It"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"s"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" a"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" common"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" issue"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":","},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" particularly"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" with"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" older"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" or"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" custom"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" package"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" collections"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Solutions"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Here"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" are"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" most"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" common"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" solutions"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":","},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" in"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" order"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" of"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" ease"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" and"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" likelihood"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" of"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" success"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"1"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" **"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Update"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Your"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Package"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" List"},"finish_reason":null}]}
data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":**"},"finish_reason":null}]}
Why did you check Disable native tool support (use XML based tools) (optional) on the LLM configuration? Gemma 3 supports native tools.
Gemma3 1B is way too small for reliable tool calling, it is a model that is smaller than models for embedded hardware or running in a browser. Try, at least, the 4B or 12B variants.
@Falco we will try further with the inputs provided, and get back to you