Roman
16 Maggio 2025, 12:24pm
10
L’errore di Gemini è stato corretto in:
main ← structured_output_differences
opened 02:09PM - 15 May 25 UTC
This change fixes two bugs and adds a safeguard.
The first issue is that the … schema Gemini expected differed from the one sent, resulting in 400 errors when performing completions.
The second issue was that creating a new persona won't define a method for `response_format`. This has to be explicitly defined when we wrap it inside the Persona class. Also, There was a mismatch between the default value and what we stored in the DB. Some parts of the code expected symbols as keys and others as strings.
Finally, we add a safeguard when, even if asked to, the model refuses to reply with a valid JSON. In this case, we are making a best-effort to recover and stream the raw response.
Si aspettava un formato leggermente diverso per lo schema JSON. Inoltre, ora tratteremo il completamento come testo normale se il modello non restituisce JSON valido quando richiesto.
5 Mi Piace