L'IA viene interrotta prima che finisca di scrivere

So I’ve been getting reports on the forum (and experienced them myself too) that the AI is just not finishing writing. At first I thought it was the model being a model so I didn’t think much of it… except that today I was checking and turns out the model is replying completely, but something on the UI is just cutting it off. Happens also with automation posts. I did one to do a weekly summary of the forum and it just doesn’t “finish” writing the post.

data: {"nonce": "e90626a4a8", "candidates": [{"content": {"parts": [{"text": "Longitudinal control on HKG (Hyundai, Kia, Genesis) cars with angle steering (LFA2) is an area of active development in sunnypilot. It's not a matter of simply finishing a \"regular car port","thoughtSignature": "CiQBcsjafFMGRiE4o6w0sZw7zZuBte9C9oTrfuwIjpQbPpnU6LcKagFyyNp80bv/vTM9jEh7sXozJX9m4GNmtqQNBRvWMKCoXmyhWHMpmW23o4jDekxbAxK465e1GXi3reCTEl6+21CUt9lIcqzyatOnIhAnGxXBspsD+t8+V0j2wC+YZDjkQW9Mr0jyNXKoELgKhQIBcsjafG5PrYkNwgx9YUITe3HZjvx5SzncZ2Ojy5sxTUuEUn/nyPubl1+JuTag9iAI5momjZYGu2Ikq2GQsrweK4FSZP8KJtZ0fnyY6hEYN//6a7gubhoO/rzu1/sTKc/NDt3oVx0kPZ+sW1XlYaRk3CbKfboRV+6BTcBfto0QL7ybvEQI9TpKrh7bEwESz1P1/HMip/XFdIzUxFRbIxXoBk2E/6WZkiO59uNePOixBScYV5MqzTgh+k06cUKXH8Jo+GKR6psIqwRluCiPLMkIatBp3wAnBdVjXFy1HRP1XxBGGYlrm/IxKSKryOl1OCOmG7+p4hQgms528e6jzClI7XPJ4zkK5QEBcsjafCXaY4ii0jCt1BWnhv7OLCOZsFsJUndy+KGnLoPD8MoNgoZm8lo6jf/V+NIFnMKCsdbB8zuGN4vzsuIFVNOKF4T96cvvAr1c7cMFhrapkeHBgHElQ8oVqVJbAWs9bYSMYisp1ir4zrYku8OAmia7PGfIpGDuRjKftW7qRtUftiba6SWcS0IX+fHwkmop6IZzB7CpWXkOJUso9fZzF2ZIzKkxSWM0HrKCr0kXF4+iLi7aoiFmbOxZiQAyEf4rdkxWSd4NMtqoDeHetDCrofWhbS8psN19XS41FptlkVtqimkvCtgBAXLI2nwL5IX8V/R9MzwZqCOGPLh6O4YDHwyzcPl6F0eJJ3BmuNVR14dswLOaE6SUhs6113jLWLUJk+RVe0BhztFBivv72MtMC7PeH6IlN7XA6Siozgz9H0AvLmPVOJPF6+dLhwzguDd/xaQOeVtn5ovKM0Zvto+6EC509IfNniu05+AsrgFCrO1Q3ck2IZP77Mfty/69hEpGM/QEJAtLyofnuND+O11ib09yQ/iXjCsxnPS1JUz/t3+LXNC1NtGu6CwZtLbuzP7ILHyhfZv5W8SH6KWKRvsnCtYBAXLI2nxU4u+DiCPWQyOenB5E06f9BUaemo2dWG6KK+umyOR39awa5bj3AXw07bStW1TPhedwSsBXbluHhtHbKYXdXiZZde1ub3mYpC3kHZ5B7nmKrDET29HtXGArCQn+Acq17X0k/ixqEWTLJN/jNLwQ6uDsFAajEyurBoHjdzYUcI2Xv2UnGfJcMcIwExfaRpFKSC1YRcSM+yQ3h6t/q93obZPNgubRnCtkzoLIoefeR4FZX/+b8EU5E2cstCkKK1mCrdspzlkc5OZS4LPu0hC0RMY3QgrYAQFyyNp82O39p8+kFI3YKdKX29TuoJsJvuW4vdQq9PakjWL3l1UMMK17BvJlpdEVv2Q88FC1Ka3Rrvgh7aB5fhS/1QqRvy2eCZlpS1tIHo8rGnAjiQnV435CP3jsRpfbmEHS6QS8C3fJV4WJ8ATi5gFe7WzbwuU4vryoApHLp6Z6lswkHbiYo9Km5xDB4QlvW88l5iti1zOu1DU8+RMzFXCUmJdgrb84W505vQ/Q+tjYACDQCnggwTWNoBe7qOYciTk3yXDnEpnp4Sok+FveuQZFtTs9nKrMpArOAQFyyNp8/OxVTWuH3pg1tFJWG6p/rYgEsK8ZQoFPbIih9mMUhzAbiKuEcAe/y+9c0hXrU4+MkyqvVD6H63s9Wrkh15fHTJDaWfex7WsiElxL2GsgbuV++HzKHrsdya+3e2QZpVngj2NNFrVjAKGIl0mH4u/Y7ybDUaNhmpjDK6bfalsta8IrUoKOw7WqNe0ald+P8XrGy8Bwnp43yV1G34aok06uim7IFSgixF3itjmnP4eldG5x0sy7E2mNUdGfdN2btnTKLLPKmsgjfC2lCucBAXLI2nwFCNwbEBoafguzpMjuCxN7NkllOt4Br8qAHbjl4y84ctU4UWKyvVNK3hQJ5Da/HT/1Hg1VIJfR3dDIzKsqiC6VfgeFlg6Sz/pl2f/k5zZj1zPTfW7AfsCr6nerDPAAPI33NPhnStDod8E++VdsvISm/0AYqbYpZ7nn5Fnshtc4GwDzdnIewCil0x4QzCPBaIe4Myy56bQLuOqUzcAPwoPp7u9nVNMriBkwWLZkLwWgvZ0JwzkM6Cq5/q1n0S3UCC9niyxpo2DSH5Jtcp6LBFjphOctAgsNHhaR6iS9Y7aQLJRkCucBAXLI2nxqPFreWTEgzpPskwyhP3c+BmWOU97SF67kM29n+F6B4S+1R7zyWnt32nbKCUXImy/+K713O4iApefGw8uMXQi3JBd73Rh23V2+yflfc8ioEkfOj92wLD1dw1mNLin3TRBJXnJi7dZGjOlBUuoAbQqDgdyhUDBv9QmSUiawZwLR5TRgstfbjvCcZLwadjp9Mg1+iKaoblu1MWF5J3Qj/DAVQn2JzRT9b7YMntlPXczrCSPI76LzLxeVVMxwKNrcohDz93mGR29iuGK2Y7Xd7EdX1v6+YG47J3AbdBeGoyOVMd+PCpMCAXLI2ny7Y1WDW8MWZqt24bjtPzOSnxKdoGtflzCSb9j39+nZRb71gd+dZ4l+ge25jzx+Xbir/yQLqo9Sj2ARI7WGNmR68WfE7JbYb/vFoJpGeL4o72h/LgCfot6HIXk/+ol77SpnAq0lrF1b2DZ+xaSNYevOWbwVhPkmPlae2eU4UWE6TLTsrzbzV2QtFbO4rAJVGW1GAs0RNtwIszKSKL29huHEtr+PUI/KuQpA4ZFkJe2S4uAktty2YuNkgsSU6ceCWo1rVUmtRyILKGKdR4hVaX2HmbtAbJmZ1kQsBlyq08TldBTxyfk6yQYBnn26ZpXN4wzxusC6LvCwLLvyWxb8HVI9yJpvBThI5kUiRWZpcLwK3AEBcsjafKWLGNajcg6g9PbgvTUFkAYNH2+V/hdR72UKmKdD4LCnk9Qw40Rf8i3eVdPjT/fXIyd/U14LPisMhQogxXjm72KdgYL8W72+4r5yC+6hDL5u1mvimI0iXkPcodW3/vvY0wxx3QLeIItyeaNXMXdB4ohrNRgCaNyCQfpQ0bMT5lPa5DfwWww76AXxjpVxs4TgBni1slWVO8nruqyLZhG1rMLCI6WP37bspYILKGOKHWF0OKF60gZL6bmqMpASDiqi7Pg2Tzv+idvfC3ca/R/dQsHIL6L/edaiCocCAXLI2nwGVYCk1kVAwDrW+H5fzwuQSWiVTAnAvPYv3ElvDrxsEVrT82ZKdJ5IExzlXjvbYZGlgjo5kPePWKBX1QVAl842pOLSb/eDSzDpD6YAJ7+0JV+y+2h7LpyiFUdG2mX3j2QAkslAu3/VDr1LRIGuv58Qwbo7py5BdnDLIb45Y8iPmzl40jc29Xcq/sRh7nKMVtBAUK5HRVLkEuY2eW8UUr43L+Zdm1LEkLXz0fcYHPSaWO1pVisoBBaxvKzMEyhi4eBV06DTKA7jzqBfIy+A1o9rtO9Y64XnUrHEwjQ+jxQDTrWGoLh9j4f9A95tu4SmDrC58Sm/EgVfzo88nkQmO0JiBDgK/QEBcsjafLzEkSnVLMQ1vde+FBjpiK3hBfBSGVk1km2Lqk+ZToTj0sWE/8BcUQ72iHt3jMUs3VZN15qci8trtGE8Ua1LQ+B9akbQ2byUpT5WizmbT54kgA+B8vU/wiq2El86k4mutbdwTuNtSt3nZsjPFWuKEGu+zoO0GeGtQkAU6XOgNK6mPapAfNIojRVLQdrkcQM8W3ZkU/iQ/DHzkmqOo4oAqiJVgTxrDFx2my/Sn0rfa9P3DEy5/NsnJpJMWcjrXfWpPl/jEZF47RCwffyKX8FJqTNNowdwnLb1/2ElbxQ9zQppn408BAwrIDCbpFlZ+GqAYzSLDuacaTWwCpgCAXLI2nzRpsiZpsCeuOTo6Y8d989U4ORaixkC4WQEIywlFZf8HiMthqXlbf1VSD9OgfAfZc7chyD2aydT1xQd+gjhIu1vXaHbBO0qSfTt+B/z+JRDGEiww1XjYYSdCGRm9/XSI8npyowXXXlcVYUsKsLIqu5IVA8IslzWhIFbhkKMe0kP/FS6zqR66oXX2t/nlJ95cmrD/wC9oqFaXCx7qcSDljXwL06tBHWdKwWrkO6YP0733d8jCHcWtVrfbxGus5T8FkUAJnBY3oKSPLQPA5d7hvPovyrFMl+xs5Mv3iSKTIFlc3VfQgJjO8Kq4QqoLP57qcHBeYeO4D9Ab5cVDXNOR/0V7Ur+cZdjQUWib+99bIW3NmWQ8wrdAQFyyNp8wAY11eQeRNEY9azg+mu/DGxbhqhOGziyEjLF6sXUDgTGHN6PJXY142XdwCyGNI+EXTUpxpOImxoaSK0GNzKr8kNTVhMs/L4QzbJOWFEGQli8biuYlky36BwAVzX9NVKAFmuzPdbPqpK6jfAnr3pdvNnayoBRIp5KPNNqDQwwgWXjn8NJTZ9pq5OztlvR4WS/nwhxuCUbh8+8AkYyKX2xz0QNbDyogiavC8RRbUntPhgj04f945hlVK4LpahO8fFiqJJRkDha02ALGZCISVrlpZvTnSgZP1ej"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 48,"totalTokenCount": 21305,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "f743860cb8", "candidates": [{"content": {"parts": [{"text": "\" in the traditional sense, as these vehicles utilize a newer control API that requires specialized implementation.\n\nHere's a summary of the situation based on discussions in the community:\n\n*   **New Control API:** Angle steering (LFA2)"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 98,"totalTokenCount": 21355,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "fd16d9ff", "candidates": [{"content": {"parts": [{"text": " refers to a new control API from Hyundai, Kia, and Genesis, which primarily applies to 2025+ models. sunnypilot's implementation needs to adapt to this new system.\n*   **Development Branches:**"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 147,"totalTokenCount": 21404,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "4f85", "candidates": [{"content": {"parts": [{"text": " There are specific development branches for angle steering, such as `hkg-angle-steering-2025` (active development) and `hkg-angle-steering-2025-prebuilt` (stable testing"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 195,"totalTokenCount": 21452,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "9ca7bd", "candidates": [{"content": {"parts": [{"text": ").\n*   **Work in Progress:** Some branches, like `hkg-angle-steering-2025-hda1`, are currently on hold as other core branches (`ccnc` and `hkg-angle-steering-branch"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 246,"totalTokenCount": 21503,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "fb9ecd1b15a7", "candidates": [{"content": {"parts": [{"text": "-2025`) need to converge first. This means that full longitudinal control on all angle steering configurations is still being developed.\n*   **Limitations and Recommendations:**\n    *   If you're on a non-HDA1"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 296,"totalTokenCount": 21553,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "fd3cac2dd11ba065", "candidates": [{"content": {"parts": [{"text": " angle steering branch, you might not have full longitudinal control and could see dashboard warnings, though other functionalities should work.\n    *   NNLC (Neural Network Longitudinal Control) is not currently supported for any angle steering cars in sunnypilot"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 345,"totalTokenCount": 21602,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "549c58", "candidates": [{"content": {"parts": [{"text": " or openpilot.\n    *   For optimal and safe operation, proper car porting is recommended. If your specific vehicle model isn't officially ported, using a similar model might work, but it's advised to provide a route and"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 394,"totalTokenCount": 21651,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "9cfd63cbefcde6", "candidates": [{"content": {"parts": [{"text": " request proper porting for safety reasons.\n    *   If you're using a prebuilt angle steering branch and find the longitudinal control a bit limited, some users have found success by adjusting \"min active torque\" in the steering settings"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 442,"totalTokenCount": 21699,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "998628", "candidates": [{"content": {"parts": [{"text": " (e.g., to 90% or 95%).\n\nIn essence, special work is indeed needed due to the new control API for LFA2 cars, and while progress is being made on dedicated branches, it's still an"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 493,"totalTokenCount": 21750,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "2f", "candidates": [{"content": {"parts": [{"text": " evolving feature set with some current limitations.\n\nYou can follow the ongoing discussions and updates in the #Vehicle-Talk:Hyundai-Kia-Genesis category, especially in the thread [Support for newer vehicles equipped with Angle Steering (LFA2"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 541,"totalTokenCount": 21798,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "15d69a6453c811", "candidates": [{"content": {"parts": [{"text": ")](https://community.sunnypilot.ai/t/support-for-newer-vehicles-equipped-with-angle-steering-lfa2/22)."}],"role": "model"},"finishReason": "STOP","index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 578,"totalTokenCount": 21835,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}


Any hint to where to look and investigate would help me a ton. Thank you !

1 Mi Piace

Ho risolto alcuni problemi relativi a questo esatto problema in:

Nello specifico, la riproduzione coerente del problema consisteva nell’avere 2 conversazioni in corso e nel passare rapidamente tra di esse.
Sei… quasi… a quel commit, il commit dovrebbe arrivare a metà di questa settimana.

Volevo solo confermare, quando ricarichi la pagina dopo che tutto è stato fatto, vedi le cose apparire correttamente?

purtroppo non è così, è come se il messaggio fosse stato inviato tagliato e basta, anche se chiaramente il debug mostra che la risposta era completa… Quindi temo di dover dire che questo potrebbe essere un problema diverso? Ha iniziato a succedere intorno al 25 novembre, forse un paio di giorni prima? Un altro presentimento che ho è che sembra accadere quando alla conversazione viene dato un titolo, ma potrei sbagliarmi o potrebbe essere solo una coincidenza

Grazie, scusa, pensavo fossi ospitato da noi :hugs: Stavo per offrire di accedere e aiutare a indagare.

Puoi dare un’occhiata in /logs ci sono errori lì? Sembra che tu stia usando l’endpoint di compatibilità openai per gemini, puoi provare quello di gemini per vedere se i risultati sono diversi?

1 Mi Piace

Nulla in particolare attira la mia attenzione nei log

(Scusate per gli screenshot dal telefono, sono stato fuori tutto il giorno per il mio compleanno ma non posso lasciar perdere questo hahahah)

Non ero a conoscenza di usarlo, ma questo succede con qualsiasi modello… anche quelli di ChatGPT o persino gemini3. Uso il gateway AI di Cloudflare. Ma ho anche provato senza e il risultato è lo stesso

Modifica:

Riguardo all’endpoint di compatibilità… non sono sicuro se lo sto usando male ma non penso di star colpendo l’endpoint di compatibilità, capisco che finisca in /openai ma non è questo il caso nel mio. Condivido la configurazione che ho nel caso possa dare un indizio.

Inoltre ho la sensazione che questo abbia iniziato ad accadere anche quando ho abilitato le quote ma non sono soggetto ad esse e questo succede anche con modelli o assistenti senza quota. Quindi potrebbe essere del tutto casuale

Quei dati a cui hai collegato non mi sembrano dati del provider Google, mi sembrano dati del provider OpenAI, puoi provare a cambiarli e vedere cosa succede?

Purtroppo impostarlo su provider OpenAI lo fa fallire (non è possibile ‘eseguire il test’), quindi il provider google lo fa sicuramente passare. Rimuoverò il gateway AI di Cloudflare per testare ‘grezzo’, ma ciò che mi sorprende è che i dati vengono comunque ricevuti completamente da Discourse, altrimenti quei dati di risposta che ho pubblicato non sarebbero visibili. Li ottengo quando clicco sul pulsante “info” e faccio copia risposta.

Modifica:

Passare dal gateway AI di Cloudflare all’API direttamente sembra dare buoni risultati. Continuerò a monitorare e testare.

1 Mi Piace