Soporte para configurar un bot de IA para un foro de comunidad de soporte con la última versión de Discourse

Soporte
1

He configurado las funciones de LLM, incrustación y persona; sin embargo, mi prompt no está proporcionando las respuestas esperadas de las preguntas y respuestas o de los recursos de wiki disponibles dentro de nuestra comunidad.

LLM autoalojado: mistral:latest
Incrustación autoalojada: all-minilm:latest

Persona:

image
image815×823 24.6 KB

image
image722×786 25.4 KB

image
image618×793 24.6 KB

¿Podría alguien ayudarme más con lo que hay que hacer? Teniendo en cuenta a un novato en IA.

2

¿Qué modelo Mistral exacto es este?

¿Puedes compartir el prompt?

Puedes añadir Search como una "Herramienta Forzada" para la primera interacción para ayudar a anclar el modelo.

3

@Falco, A continuación se detallan los detalles para responder:

¿Qué modelo exacto de Mistral es este?

Modelo LLM: mistral:latest

Enlace:
El modelo en https://ollama.com/library/mistral:latest es:

Mistral 7B v0.3 — un modelo de código abierto de 7 mil millones de parámetros lanzado por Mistral AI.

¿Puedes compartir el prompt?

Prompt del sistema:

Eres un asistente de conocimiento comunitario diseñado para este foro llamado {site_title} y con URL de sitio {site_url}, teniendo ingenieros como usuarios.

Siempre busca y referencia publicaciones relevantes del foro, artículos de wiki y discusiones etiquetadas antes de generar una respuesta.

Tu primera prioridad es usar el contenido recuperado del foro (a través de la búsqueda de embeddings) para elaborar respuestas.

  Prefiere resúmenes y citas de publicaciones existentes.
  Si se encuentran múltiples temas relacionados, combínalos claramente.
  Solo si no existe contenido relevante, responde usando tu conocimiento general a través del LLM.
  Incluye títulos de temas o URLs al referenciar publicaciones.
  Nunca inventes o crees respuestas no respaldadas por datos del foro.
  Sé factual, conciso y profesional.
  Cuando los usuarios hagan preguntas amplias, prefiere resumir múltiples fuentes en lugar de adivinar.
  Siempre prefiere el contexto de categorías, etiquetas y wikis indexados en embeddings.

Se actualizó la herramienta forzada como se sugirió

4

Me temo que un modelo de 2023 reutilizado no será suficiente aquí. Además, según la propia documentación de Ollama para este modelo, solo admite llamadas a herramientas en la API sin procesar, que no es lo que usamos.

En general, esta es una mala elección para AI Bot hoy.

En su lugar, use uno de los siguientes:

1 me gusta
5

Hola @Falco, y lo siento, gracias por las aportaciones. Lo comprobaremos y le informaremos más adelante.

1 me gusta
6

@Falco Recibiendo un error 502 al habilitar LLM. Por favor, encuentra los registros a continuación.

image
image586×822 23.5 KB

image
image817×806 32.4 KB

Mensaje

El worker de Unicorn recibió la señal USR2 indicando que está a punto de agotar el tiempo de espera, volcando el backtrace para el hilo principal
config/unicorn.conf.rb:203:in `backtrace'
config/unicorn.conf.rb:203:in `block (2 levels) in reload'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:229:in `wait_readable'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:229:in `rbuf_fill'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:199:in `readuntil'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:209:in `readline'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http/response.rb:158:in `read_status_line'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http/response.rb:147:in `read_new'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2420:in `block in transport_request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2411:in `catch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2411:in `transport_request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2384:in `request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/patches/net_patches.rb:19:in `block in request_with_mini_profiler'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/mini_profiler/profiling_methods.rb:45:in `step'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/patches/net_patches.rb:18:in `request_with_mini_profiler'
/var/www/discourse/plugins/discourse-ai/lib/completions/endpoints/base.rb:168:in `block in perform_completion!'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:1632:in `start'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:1070:in `start'
/var/www/di...

Backtrace

/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:130:in `block in warn'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `block in dispatch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `each'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `dispatch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:130:in `warn'
/var/www/discourse/lib/signal_trap_logger.rb:40:in `public_send'
/var/www/discourse/lib/signal_trap_logger.rb:40:in `block (2 levels) in ensure_logging_thread_running'
internal:kernel:187:in `loop'
/var/www/discourse/lib/signal_trap_logger.rb:37:in `block in ensure_logging_thread_running'
7

Establezca el proveedor en OpenAI si está utilizando la API compatible con OpenAI de Ollama.

1 me gusta
8

@Falco

He intentado con el proveedor openAI y el problema persiste.

Mensaje

Unicorn worker received USR2 signal indicating it is about to timeout, dumping backtrace for main thread
config/unicorn.conf.rb:203:in `backtrace'
config/unicorn.conf.rb:203:in `block (2 levels) in reload'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:229:in `wait_readable'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:229:in `rbuf_fill'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:199:in `readuntil'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-protocol-0.2.2/lib/net/protocol.rb:209:in `readline'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http/response.rb:158:in `read_status_line'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http/response.rb:147:in `read_new'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2420:in `block in transport_request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2411:in `catch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2411:in `transport_request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:2384:in `request'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/patches/net_patches.rb:19:in `block in request_with_mini_profiler'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/mini_profiler/profiling_methods.rb:45:in `step'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/rack-mini-profiler-4.0.1/lib/patches/net_patches.rb:18:in `request_with_mini_profiler'
/var/www/discourse/plugins/discourse-ai/lib/completions/endpoints/base.rb:168:in `block in perform_completion!'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:1632:in `start'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/net-http-0.6.0/lib/net/http.rb:1070:in `start'
/var/www/di...

Backtrace

/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:130:in `block in warn'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `block in dispatch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `each'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:231:in `dispatch'
/var/www/discourse/vendor/bundle/ruby/3.3.0/gems/activesupport-8.0.2.1/lib/active_support/broadcast_logger.rb:130:in `warn'
/var/www/discourse/lib/signal_trap_logger.rb:40:in `public_send'
/var/www/discourse/lib/signal_trap_logger.rb:40:in `block (2 levels) in ensure_logging_thread_running'
kernel:187:in `loop'
/var/www/discourse/lib/signal_trap_logger.rb:37:in `block in ensure_logging_thread_running'
9

¿Puede tu contenedor de Discourse acceder al servicio en el puerto 11434? Si se está ejecutando en el host, necesitas proporcionar una forma para que la red cruce el límite del contenedor.

10

Sí, pude acceder a uno de los modelos LLM anteriormente con el mismo puerto con el contenedor de Discourse.

11

¿Podrías ayudarme con esto y cuál es el requisito mínimo de RAM donde se está ejecutando este LLM?

12

Así que puede ser

13

Hola @Falco

He integrado con éxito el Modelo de Lenguaje (LLM) que se describe a continuación. Sin embargo, me he encontrado con un problema durante mi proceso de consulta: el prompt no tiene en cuenta el contenido específico de mi foro. En lugar de basarse en las discusiones y perspectivas relevantes dentro de mi foro, está generando respuestas basadas en información preexistente del LLM. ¿Qué pasos debo seguir para rectificar esta situación y asegurar que el modelo incorpore eficazmente las contribuciones únicas de mi foro?

LLM utilizado como se sugirió anteriormente:

Ejemplo:

image

14

En la sección Herramientas de la persona, asegúrate de que tenga acceso tanto a Buscar como a Leer, y configura Buscar como Herramienta forzada.

image

Además, ¿es el contenido del foro donde se supone que la Persona debe buscar todo público?

15

@Falco, me gustaría que mi bot proporcione respuestas derivadas del contenido almacenado en mi Base de Conocimiento. ¿Podrías compartir la configuración completa relacionada con el plugin de IA y otros? Además, ¿necesitamos ejecutar algún comando específico dentro de la aplicación para habilitar la Generación Aumentada por Recuperación (RAG)?

16

@Falco ¿podrías revisar y dar tu opinión sobre lo anterior?

17

Habilite la depuración del bot a través de AI bot debugging allowed groups y compruebe qué llamadas a herramientas está realizando el bot y cuáles son las respuestas.

18

@Falco The following are the details

Request tokens: 1304
Response tokens: 652
model: gemma3:1b
messages:
0:
role: system
content: You are a helpful Discourse assistant.
You _understand_ and **generate** Discourse Markdown.
You live in a Discourse Forum Message.

You live in the forum with the URL: https://faq.company.com
The title of your site: company FAQ
The description is: company Community Portal
The participants in this conversation are: Forum_Helper_bot, testuser
The date now is: 2025-12-02 08:36:27 UTC, much has changed since you were trained.

You were trained on OLD data, lean on search to get up to date information about this forum
When searching try to SIMPLIFY search terms
Discourse search joins all terms with AND. Reduce and simplify terms to find more results.

In this environment you have access to a set of tools you can use to answer the user's question.
You may call them like this.

<function_calls>
<invoke>
<tool_name>$TOOL_NAME</tool_name>
<parameters>
<$PARAMETER_NAME>$PARAMETER_VALUE</$PARAMETER_NAME>
...
</parameters>
</invoke>
</function_calls>

If you wish to call multiple function in one reply, wrap multiple <invoke>
block in a single <function_calls> block.

- Always prefer to lead with tool calls, if you need to execute any.
- Avoid all niceties prior to tool calls, Eg: "Let me look this up for you.." etc.
- DO NOT encode HTML entities in tool calls. You may use <![CDATA[...]]> for encoding if required.
Here are the complete list of tools available:

<tools>
<tool_description>
<tool_name>categories</tool_name>
<description>Will list the categories on the current discourse instance, prefer to format with # in front of the category name</description>
<parameters>
</parameters>
</tool_description>
<tool_description>
<tool_name>search</tool_name>
<description>Will search topics in the current discourse instance, when rendering always prefer to link to the topics you find</description>
<parameters>
<parameter>
<name>search_query</name>
<type>string</type>
<description>Specific keywords to search for, space separated (correct bad spelling, remove connector words)</description>
<required>false</required>
</parameter>
<parameter>
<name>user</name>
<type>string</type>
<description>Filter search results to this username (only include if user explicitly asks to filter by user)</description>
<required>false</required>
</parameter>
<parameter>
<name>order</name>
<type>string</type>
<description>search result order</description>
<required>false</required>
<options>latest,latest_topic,oldest,views,likes</options>
</parameter>
<parameter>
<name>max_results</name>
<type>integer</type>
<description>limit number of results returned (generally prefer to just keep to default)</description>
<required>false</required>
</parameter>
<parameter>
<name>max_posts</name>
<type>integer</type>
<description>maximum number of posts on the topics (topics where lots of people posted)</description>
<required>false</required>
</parameter>
<parameter>
<name>tags</name>
<type>string</type>
<description>list of tags to search for. Use + to join with OR, use , to join with AND</description>
<required>false</required>
</parameter>
<parameter>
<name>category</name>
<type>string</type>
<description>category name to filter to</description>
<required>false</required>
</parameter>
<parameter>
<name>before</name>
<type>string</type>
<description>only topics created before a specific date YYYY-MM-DD</description>
<required>false</required>
</parameter>
<parameter>
<name>after</name>
<type>string</type>
<description>only topics created after a specific date YYYY-MM-DD</description>
<required>false</required>
</parameter>
<parameter>
<name>status</name>
<type>string</type>
<description>search for topics in a particular state</description>
<required>false</required>
<options>open,closed,archived,noreplies,single_user</options>
</parameter>
</parameters>
</tool_description>
<tool_description>
<tool_name>read</tool_name>
<description>Will read a topic or a post on this Discourse instance</description>
<parameters>
<parameter>
<name>topic_id</name>
<type>integer</type>
<description>the id of the topic to read</description>
<required>true</required>
</parameter>
<parameter>
<name>post_numbers</name>
<type>array</type>
<description>the post numbers to read (optional)</description>
<required>false</required>
<array_item_type>integer</array_item_type>
</parameter>
</parameters>
</tool_description>
<tool_description>
<tool_name>tags</tool_name>
<description>Will list the 100 most popular tags on the current discourse instance</description>
<parameters>
</parameters>
</tool_description>
</tools>
1:
role: user
name: testuser
content: How to resolve - apt package zliblg:i386 does not exist
stream: true
stream_options:
include_usage: true

Response

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Okay"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":","},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" let"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"s"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" tackle"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" \""},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"apt"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" package"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" z"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"lib"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"lg"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"i"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"3"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"8"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"6"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" does"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" not"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" exist"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\""},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" error"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" This"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" usually"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" means"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" package"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" you"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"re"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664602,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" trying"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" to"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" install"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" isn"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"t"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" available"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" through"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" standard"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Ubuntu"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" repositories"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Here"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"s"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" a"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" breakdown"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" of"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" what"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"s"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" happening"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" and"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" how"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" to"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" fix"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" it"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Understanding"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Problem"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"The"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" error"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" indicates"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" that"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" `"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"z"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"lib"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"lg"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"i"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"3"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"8"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"6"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"`"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" package"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" isn"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"’"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"t"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" found"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" in"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" repositories"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" used"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" by"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" your"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Ubuntu"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" system"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"  "},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"It"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"'"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"s"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" a"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" common"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" issue"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":","},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" particularly"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" with"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" older"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" or"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" custom"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" package"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" collections"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Solutions"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Here"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" are"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" the"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" most"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" common"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" solutions"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":","},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" in"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" order"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" of"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" ease"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" and"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" likelihood"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" of"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" success"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"\n\n"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"1"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"."},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" **"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":"Update"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Your"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" Package"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":" List"},"finish_reason":null}]}

data: {"id":"chatcmpl-678","object":"chat.completion.chunk","created":1764664603,"model":"gemma3:1b","system_fingerprint":"fp_ollama","choices":[{"index":0,"delta":{"role":"assistant","content":":**"},"finish_reason":null}]}
19

  1. ¿Por qué marcó la casilla Deshabilitar compatibilidad con herramientas nativas (usar herramientas basadas en XML) (opcional) en la configuración de LLM? Gemma 3 admite herramientas nativas.

  2. Gemma3 1B es demasiado pequeño para la invocación de herramientas de manera confiable; es un modelo más pequeño que los modelos para hardware integrado o para ejecutarse en un navegador. Pruebe, como mínimo, las variantes de 4B o 12B.

20

@Falco intentaremos más con las entradas proporcionadas y te responderemos