AI is being cutoff before it finishes writing

So I’ve been getting reports on the forum (and experienced them myself too) that the AI is just not finishing writing. At first I thought it was the model being a model so I didn’t think much of it… except that today I was checking and turns out the model is replying completely, but something on the UI is just cutting it off. Happens also with automation posts. I did one to do a weekly summary of the forum and it just doesn’t “finish” writing the post.

data: {"nonce": "e90626a4a8", "candidates": [{"content": {"parts": [{"text": "Longitudinal control on HKG (Hyundai, Kia, Genesis) cars with angle steering (LFA2) is an area of active development in sunnypilot. It's not a matter of simply finishing a \"regular car port","thoughtSignature": "CiQBcsjafFMGRiE4o6w0sZw7zZuBte9C9oTrfuwIjpQbPpnU6LcKagFyyNp80bv/vTM9jEh7sXozJX9m4GNmtqQNBRvWMKCoXmyhWHMpmW23o4jDekxbAxK465e1GXi3reCTEl6+21CUt9lIcqzyatOnIhAnGxXBspsD+t8+V0j2wC+YZDjkQW9Mr0jyNXKoELgKhQIBcsjafG5PrYkNwgx9YUITe3HZjvx5SzncZ2Ojy5sxTUuEUn/nyPubl1+JuTag9iAI5momjZYGu2Ikq2GQsrweK4FSZP8KJtZ0fnyY6hEYN//6a7gubhoO/rzu1/sTKc/NDt3oVx0kPZ+sW1XlYaRk3CbKfboRV+6BTcBfto0QL7ybvEQI9TpKrh7bEwESz1P1/HMip/XFdIzUxFRbIxXoBk2E/6WZkiO59uNePOixBScYV5MqzTgh+k06cUKXH8Jo+GKR6psIqwRluCiPLMkIatBp3wAnBdVjXFy1HRP1XxBGGYlrm/IxKSKryOl1OCOmG7+p4hQgms528e6jzClI7XPJ4zkK5QEBcsjafCXaY4ii0jCt1BWnhv7OLCOZsFsJUndy+KGnLoPD8MoNgoZm8lo6jf/V+NIFnMKCsdbB8zuGN4vzsuIFVNOKF4T96cvvAr1c7cMFhrapkeHBgHElQ8oVqVJbAWs9bYSMYisp1ir4zrYku8OAmia7PGfIpGDuRjKftW7qRtUftiba6SWcS0IX+fHwkmop6IZzB7CpWXkOJUso9fZzF2ZIzKkxSWM0HrKCr0kXF4+iLi7aoiFmbOxZiQAyEf4rdkxWSd4NMtqoDeHetDCrofWhbS8psN19XS41FptlkVtqimkvCtgBAXLI2nwL5IX8V/R9MzwZqCOGPLh6O4YDHwyzcPl6F0eJJ3BmuNVR14dswLOaE6SUhs6113jLWLUJk+RVe0BhztFBivv72MtMC7PeH6IlN7XA6Siozgz9H0AvLmPVOJPF6+dLhwzguDd/xaQOeVtn5ovKM0Zvto+6EC509IfNniu05+AsrgFCrO1Q3ck2IZP77Mfty/69hEpGM/QEJAtLyofnuND+O11ib09yQ/iXjCsxnPS1JUz/t3+LXNC1NtGu6CwZtLbuzP7ILHyhfZv5W8SH6KWKRvsnCtYBAXLI2nxU4u+DiCPWQyOenB5E06f9BUaemo2dWG6KK+umyOR39awa5bj3AXw07bStW1TPhedwSsBXbluHhtHbKYXdXiZZde1ub3mYpC3kHZ5B7nmKrDET29HtXGArCQn+Acq17X0k/ixqEWTLJN/jNLwQ6uDsFAajEyurBoHjdzYUcI2Xv2UnGfJcMcIwExfaRpFKSC1YRcSM+yQ3h6t/q93obZPNgubRnCtkzoLIoefeR4FZX/+b8EU5E2cstCkKK1mCrdspzlkc5OZS4LPu0hC0RMY3QgrYAQFyyNp82O39p8+kFI3YKdKX29TuoJsJvuW4vdQq9PakjWL3l1UMMK17BvJlpdEVv2Q88FC1Ka3Rrvgh7aB5fhS/1QqRvy2eCZlpS1tIHo8rGnAjiQnV435CP3jsRpfbmEHS6QS8C3fJV4WJ8ATi5gFe7WzbwuU4vryoApHLp6Z6lswkHbiYo9Km5xDB4QlvW88l5iti1zOu1DU8+RMzFXCUmJdgrb84W505vQ/Q+tjYACDQCnggwTWNoBe7qOYciTk3yXDnEpnp4Sok+FveuQZFtTs9nKrMpArOAQFyyNp8/OxVTWuH3pg1tFJWG6p/rYgEsK8ZQoFPbIih9mMUhzAbiKuEcAe/y+9c0hXrU4+MkyqvVD6H63s9Wrkh15fHTJDaWfex7WsiElxL2GsgbuV++HzKHrsdya+3e2QZpVngj2NNFrVjAKGIl0mH4u/Y7ybDUaNhmpjDK6bfalsta8IrUoKOw7WqNe0ald+P8XrGy8Bwnp43yV1G34aok06uim7IFSgixF3itjmnP4eldG5x0sy7E2mNUdGfdN2btnTKLLPKmsgjfC2lCucBAXLI2nwFCNwbEBoafguzpMjuCxN7NkllOt4Br8qAHbjl4y84ctU4UWKyvVNK3hQJ5Da/HT/1Hg1VIJfR3dDIzKsqiC6VfgeFlg6Sz/pl2f/k5zZj1zPTfW7AfsCr6nerDPAAPI33NPhnStDod8E++VdsvISm/0AYqbYpZ7nn5Fnshtc4GwDzdnIewCil0x4QzCPBaIe4Myy56bQLuOqUzcAPwoPp7u9nVNMriBkwWLZkLwWgvZ0JwzkM6Cq5/q1n0S3UCC9niyxpo2DSH5Jtcp6LBFjphOctAgsNHhaR6iS9Y7aQLJRkCucBAXLI2nxqPFreWTEgzpPskwyhP3c+BmWOU97SF67kM29n+F6B4S+1R7zyWnt32nbKCUXImy/+K713O4iApefGw8uMXQi3JBd73Rh23V2+yflfc8ioEkfOj92wLD1dw1mNLin3TRBJXnJi7dZGjOlBUuoAbQqDgdyhUDBv9QmSUiawZwLR5TRgstfbjvCcZLwadjp9Mg1+iKaoblu1MWF5J3Qj/DAVQn2JzRT9b7YMntlPXczrCSPI76LzLxeVVMxwKNrcohDz93mGR29iuGK2Y7Xd7EdX1v6+YG47J3AbdBeGoyOVMd+PCpMCAXLI2ny7Y1WDW8MWZqt24bjtPzOSnxKdoGtflzCSb9j39+nZRb71gd+dZ4l+ge25jzx+Xbir/yQLqo9Sj2ARI7WGNmR68WfE7JbYb/vFoJpGeL4o72h/LgCfot6HIXk/+ol77SpnAq0lrF1b2DZ+xaSNYevOWbwVhPkmPlae2eU4UWE6TLTsrzbzV2QtFbO4rAJVGW1GAs0RNtwIszKSKL29huHEtr+PUI/KuQpA4ZFkJe2S4uAktty2YuNkgsSU6ceCWo1rVUmtRyILKGKdR4hVaX2HmbtAbJmZ1kQsBlyq08TldBTxyfk6yQYBnn26ZpXN4wzxusC6LvCwLLvyWxb8HVI9yJpvBThI5kUiRWZpcLwK3AEBcsjafKWLGNajcg6g9PbgvTUFkAYNH2+V/hdR72UKmKdD4LCnk9Qw40Rf8i3eVdPjT/fXIyd/U14LPisMhQogxXjm72KdgYL8W72+4r5yC+6hDL5u1mvimI0iXkPcodW3/vvY0wxx3QLeIItyeaNXMXdB4ohrNRgCaNyCQfpQ0bMT5lPa5DfwWww76AXxjpVxs4TgBni1slWVO8nruqyLZhG1rMLCI6WP37bspYILKGOKHWF0OKF60gZL6bmqMpASDiqi7Pg2Tzv+idvfC3ca/R/dQsHIL6L/edaiCocCAXLI2nwGVYCk1kVAwDrW+H5fzwuQSWiVTAnAvPYv3ElvDrxsEVrT82ZKdJ5IExzlXjvbYZGlgjo5kPePWKBX1QVAl842pOLSb/eDSzDpD6YAJ7+0JV+y+2h7LpyiFUdG2mX3j2QAkslAu3/VDr1LRIGuv58Qwbo7py5BdnDLIb45Y8iPmzl40jc29Xcq/sRh7nKMVtBAUK5HRVLkEuY2eW8UUr43L+Zdm1LEkLXz0fcYHPSaWO1pVisoBBaxvKzMEyhi4eBV06DTKA7jzqBfIy+A1o9rtO9Y64XnUrHEwjQ+jxQDTrWGoLh9j4f9A95tu4SmDrC58Sm/EgVfzo88nkQmO0JiBDgK/QEBcsjafLzEkSnVLMQ1vde+FBjpiK3hBfBSGVk1km2Lqk+ZToTj0sWE/8BcUQ72iHt3jMUs3VZN15qci8trtGE8Ua1LQ+B9akbQ2byUpT5WizmbT54kgA+B8vU/wiq2El86k4mutbdwTuNtSt3nZsjPFWuKEGu+zoO0GeGtQkAU6XOgNK6mPapAfNIojRVLQdrkcQM8W3ZkU/iQ/DHzkmqOo4oAqiJVgTxrDFx2my/Sn0rfa9P3DEy5/NsnJpJMWcjrXfWpPl/jEZF47RCwffyKX8FJqTNNowdwnLb1/2ElbxQ9zQppn408BAwrIDCbpFlZ+GqAYzSLDuacaTWwCpgCAXLI2nzRpsiZpsCeuOTo6Y8d989U4ORaixkC4WQEIywlFZf8HiMthqXlbf1VSD9OgfAfZc7chyD2aydT1xQd+gjhIu1vXaHbBO0qSfTt+B/z+JRDGEiww1XjYYSdCGRm9/XSI8npyowXXXlcVYUsKsLIqu5IVA8IslzWhIFbhkKMe0kP/FS6zqR66oXX2t/nlJ95cmrD/wC9oqFaXCx7qcSDljXwL06tBHWdKwWrkO6YP0733d8jCHcWtVrfbxGus5T8FkUAJnBY3oKSPLQPA5d7hvPovyrFMl+xs5Mv3iSKTIFlc3VfQgJjO8Kq4QqoLP57qcHBeYeO4D9Ab5cVDXNOR/0V7Ur+cZdjQUWib+99bIW3NmWQ8wrdAQFyyNp8wAY11eQeRNEY9azg+mu/DGxbhqhOGziyEjLF6sXUDgTGHN6PJXY142XdwCyGNI+EXTUpxpOImxoaSK0GNzKr8kNTVhMs/L4QzbJOWFEGQli8biuYlky36BwAVzX9NVKAFmuzPdbPqpK6jfAnr3pdvNnayoBRIp5KPNNqDQwwgWXjn8NJTZ9pq5OztlvR4WS/nwhxuCUbh8+8AkYyKX2xz0QNbDyogiavC8RRbUntPhgj04f945hlVK4LpahO8fFiqJJRkDha02ALGZCISVrlpZvTnSgZP1ej"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 48,"totalTokenCount": 21305,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "f743860cb8", "candidates": [{"content": {"parts": [{"text": "\" in the traditional sense, as these vehicles utilize a newer control API that requires specialized implementation.\n\nHere's a summary of the situation based on discussions in the community:\n\n*   **New Control API:** Angle steering (LFA2)"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 98,"totalTokenCount": 21355,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "fd16d9ff", "candidates": [{"content": {"parts": [{"text": " refers to a new control API from Hyundai, Kia, and Genesis, which primarily applies to 2025+ models. sunnypilot's implementation needs to adapt to this new system.\n*   **Development Branches:**"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 147,"totalTokenCount": 21404,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "4f85", "candidates": [{"content": {"parts": [{"text": " There are specific development branches for angle steering, such as `hkg-angle-steering-2025` (active development) and `hkg-angle-steering-2025-prebuilt` (stable testing"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 195,"totalTokenCount": 21452,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "9ca7bd", "candidates": [{"content": {"parts": [{"text": ").\n*   **Work in Progress:** Some branches, like `hkg-angle-steering-2025-hda1`, are currently on hold as other core branches (`ccnc` and `hkg-angle-steering-branch"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 246,"totalTokenCount": 21503,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "fb9ecd1b15a7", "candidates": [{"content": {"parts": [{"text": "-2025`) need to converge first. This means that full longitudinal control on all angle steering configurations is still being developed.\n*   **Limitations and Recommendations:**\n    *   If you're on a non-HDA1"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 296,"totalTokenCount": 21553,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "fd3cac2dd11ba065", "candidates": [{"content": {"parts": [{"text": " angle steering branch, you might not have full longitudinal control and could see dashboard warnings, though other functionalities should work.\n    *   NNLC (Neural Network Longitudinal Control) is not currently supported for any angle steering cars in sunnypilot"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 345,"totalTokenCount": 21602,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "549c58", "candidates": [{"content": {"parts": [{"text": " or openpilot.\n    *   For optimal and safe operation, proper car porting is recommended. If your specific vehicle model isn't officially ported, using a similar model might work, but it's advised to provide a route and"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 394,"totalTokenCount": 21651,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "9cfd63cbefcde6", "candidates": [{"content": {"parts": [{"text": " request proper porting for safety reasons.\n    *   If you're using a prebuilt angle steering branch and find the longitudinal control a bit limited, some users have found success by adjusting \"min active torque\" in the steering settings"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 442,"totalTokenCount": 21699,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "998628", "candidates": [{"content": {"parts": [{"text": " (e.g., to 90% or 95%).\n\nIn essence, special work is indeed needed due to the new control API for LFA2 cars, and while progress is being made on dedicated branches, it's still an"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 493,"totalTokenCount": 21750,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "2f", "candidates": [{"content": {"parts": [{"text": " evolving feature set with some current limitations.\n\nYou can follow the ongoing discussions and updates in the #Vehicle-Talk:Hyundai-Kia-Genesis category, especially in the thread [Support for newer vehicles equipped with Angle Steering (LFA2"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 541,"totalTokenCount": 21798,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}

data: {"nonce": "15d69a6453c811", "candidates": [{"content": {"parts": [{"text": ")](https://community.sunnypilot.ai/t/support-for-newer-vehicles-equipped-with-angle-steering-lfa2/22)."}],"role": "model"},"finishReason": "STOP","index": 0}],"usageMetadata": {"promptTokenCount": 20565,"candidatesTokenCount": 578,"totalTokenCount": 21835,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 20565}],"thoughtsTokenCount": 692},"modelVersion": "gemini-2.5-flash","responseId": "3q8saZzqKaWOjMcPgPj5oA4"}


Any hint to where to look and investigate would help me a ton. Thank you !

1 Like

I fixed some issues around this exact problem in:

Specifically the consistent repro of the issue was to have 2 conversations going and to flick between them.

You are … almost… at that commit, the commit should land middle of this week.

Just confirming though, when you reload the page after all stuff is done are you seeing stuff show up correctly?

unfortunately this is not the case, it’s as if the message was sent cut and that’s it, even though clearly the debug shows the response was complete… So I’m afraid to say this may be a different issue? It started happening around November 25th, maybe a couple days earlier ? another hunch i have is that it kinda seems to happen when the conversation is being given a title but i may be wrong there or it may just be a coincidence

Edit:

I seems like I can update 3 commits and it includes your fix so I’ll pull and give it a try and report back

Edit2:

Checked after updating but the same still happened :frowning:

data: {"nonce": "d9", "candidates": [{"content": {"parts": [{"text": "Based on discussions in the sunnypilot community, people appreciate sunnypilot for several key reasons:\n\n*   **MADS (Modified Assistive Driving System)**: Many users highlight MADS as a standout feature, making their","thoughtSignature": "CisBcsjafGUX88SKRVSpak5dja4JTsZNCFB6MV1TU1kJiZWq6qEIawdkjJqxCncBcsjafJRRffYuo/awUI0Sh9IltmyWL1nR4TO35UBGcVZWdF7n/d1wtMLYnZKF6vefz8IgyjceufSUwzZXstxK4xWWiQyk7V3LUt78uSP0iIkFh2MUdKKnEQM7y2IPmBo9X8GVrewNgRdLeZl7ms8tYG52fjPgLQrbAQFyyNp8Mul/V0e+kfSNQNmOmSIAegDIqB97pFNdkNDjxVEQcAf75dX0GcEKonU+QkT8qQLi28Kvp6jNhRB3npEYgcvVp7iunXc8Tbur+3DCuH1MyIUvYLZ+UEV0STj/zToQeFyyWvUEa/JVRq7/0RtINoAGcGb+8UDVfrF60M9sVpRZfEepJAK3bYGY+srQLwzOH1ki7/kOUnwrYLCtZCHSP+17cRS+gWXZQUxkR78Uj8UomzBWn1nq9C/pS5HFLyKYGe8WJEH3Fh9y2TcEmxWei562GSHzONCE4QraAQFyyNp81T8mEavhEgQ+KOKp2xgG3hc56ve/4atZi8suOnMs9Ni/PPkkwN/a7KJLuUqoP1+446IZO/f/BuqpCUhWzKpHIHqNRf2BaZsSlRz1NPon9rxO2TCVxgZCVovPLiuCfOHLjo1sr2TwzKDfss+HG3tnyffEPt7JTVmbFiufywlvT34xgCnhrNsGrHzV8sm8mYp4BykXxWhZufUwyznfcCRscmmsuMToxRcGTvHBejy2DVOTp7UjEMqOH3vDpS0cSi0pkAxUUNsCPvMedm+c/ZZ1tTdhPprICtEBAXLI2nyooiuUUBMwrjwvEJjEPGv+AfVDNqR3+dSEStHIg9vThewB1pceTcN1uhCQnycEWXZYiBJxYuAEkbLEnQw8CS0WodhbDVuosr2iRp0Fz/Iz6DJYTo5eL1zyQv8208FYJFKoorobb11icEeGwG4plQjJ3iOZkUzFskX+WfrqUpiNl3AaKgTOLM/taQKKkqMGktWT09R6U2XrLynlX7QXac34+bLvQIRlNDoy6ZTvlJpEmZAXoqrhSZjReFmWrn84OFEPcWl7nVbyHS5hbwoK4QEBcsjafMneza4+HxUD0v/jXvkRKb0Fy8KJFjoZTpR3YetnoiUwKwvT4+NMTto3EqkZrTKF3f3DpXj7axRcJZISfhhli8jtvl+71ocJOkovc/JWdO8T/IWsTpQVh1UkbSS12cdPFw2k/JukGPcJJMBfqqHIkrdCNY8x6q3HaxUDwItBeIB5q7OL8yjaZ4EaHyDerH7XcZdYwGAl5QXpDZ4TV7Jxy7eqxPgpTy4YxntiZQP0J1yDjfHJPdYWMeDKodWxzgmit6z3ylHdUpGYceVcEHd8E6OytNbqXkCSQNZ80TQK1wEBcsjafE1wKvCIc1Y/dhU+l5QLaVhEP0C/chpycW5CGt9yA0/SJQ0y2MrzTwD5y5bPWIEQQvPu1dTIF+6zJNSfob8Knme6Hd3MLhq/QI8FFNdZ//jfFC36pB872VnfUYRoZalDMvAQjs8sJ8K+jH0w64CWEo5VGkWOkZqkDcF3sC/l7HZ6z/qW/HEX+LmOgagkVQnD4TsojN6LIuvomrXVTi1D0gNNU5hRlsfvUZlF4ypCusmJpGG+DFL+exvNCyRN/O9l9stjKASo1g19KMpxlhp/nUdQQwrWAQFyyNp8BxKsMsJHvzAz/SKiOW7/app89YegF9Qc2JoKa4GNSZANCZwfoKEB2Cm9JIR06Jxc/yhncdgpD2TUfVST6iQ5nESwnxNscQvs8RVX2njzzUJX+d+/BERl/dWzV17xzkvISuNSY1nqH/WTWaF+qgb+l/Ux1nB1A7+GWjcZSNuO8OlRcKaJ+Q4nHVgX/gorF2e5wCLW3JsTYxLCkTFAB2lZgt8Gqffyb9UXFn+evdrQ2DYrIfICwr4QSJM6nDlRQke/y7IPUOWjM62tQK1oqBAr1z4K0AEBcsjafJdvYBFyofQNMNSrzpn6BFhjnv8WeZR14HZ+1of9/OA5PPJHfgFp6SPukZTbrr/+7BG2T6wJZyjhZ70EVKilEsnmzGhl/NyazA+FKaypJz3fNoRfq6l2XCCJ3gIvzrfDGA4Q0TzK1CYxxXOlSCZqqt95X9585ENo/ueU38yqC2/Hl2UtO+Na862ygxGHWGzMweWGOZwDELmIOdXezgdDD+RJ2z2aIgw4f+eUR9oGUOeYY0xxT+8hFntwYgR6XwIk5wYYE8bmTsNK8RnECt4BAXLI2nyF5qJ9lmpFgZ/xOU2kdkxSI2bpKfqddQ9S+rqbV84EWEyIYq+offRpofstPd4/c0mEr0oxvGk4j/XvmCxLpTEGQV/3rfixZax5c5ItOTZ13C2MY2tte2iRfmDRwGxnhEczKtJ94VhMcwPTx9vSLukso6iQgaB6KdnV373xmxf+Uljk3jYfi6ooo5UrIOx81kNOsYsbHEdVJj6lhHfqgGz/y4Ah7KHvLnQdYN7IQuimDv83zFUhAwuwFOk8dd7bUiDLtjpKpaytbebDVm1US7qjTULZZkowhj84CuwBAXLI2nyNg4P0rB/IBDc08qikjwMtsayz9pZYFXWt1CkNl86yxc1o97APWDIugR5CWwyIWgOmqlt2Sl5b14MkRNvCV3MD9e+2chRvYQ5fXUg4at8IePtNDadHhOSxsmRBpfVRsIndpZ1HkGeuZrH6O3yFj9gIYTVxJqP91ltJ71COPQK/tyGvVpUqbNYcV03HywB7BkIx7Q+ESuZR5eKl6Sbor9P2uHHH862uEYQzJVOU8edh5e6LpogJMdUA9M0snzIuQTq9hBtmZCMKlOU9MlAy0DJTBPI14GkFr35MAFoJO4R/qOypcku0p58KrQEBcsjafIYF11UB/dSo+AREHPyqyJNNScVlHcQOJ5VsYW63VYXWQZtbhlnGYh0gbXEyjRP3NCbR4NZkjRoN+3j8pO4Zyax5oWdy0ezkoYk06u1tyYqIBPs5ehmz3yhRa2IBua5vER10nBTcc5AZavnMCZQUr4NKloSMYQ2qAqBcj2XsX0fvO9vnI7pnfWFcDIFZ0tZVOY5Qwx5GJh9u4bpfAOQ8sZgQxn6/CAsoigq3AQFyyNp8OrYfpuYPk0hiGontZy61asfPSI0Vx4t4VHc7TJpUqvm9RErrmWPPLGuwURlo/qSQZmhc/g39FAzs5sZzie6Ebxp/RczJi0JxOgE0gXJX/lWYEnCM16si+AerUMmsra3gkE3YnUYwMHPyO+ob7WlWrJsUZeKIpWqDzClMQI3w8FkXrUdnJnx7ApLiU+iDzINFFti5lnp6PYkgEfluQ1PXznNY7rhYGT+i79uNIU/ME7TlvQq2AgFyyNp89M4dKtiQlB6i50mEA5qn/Vtkn0rL4ugPyZOz/dX3/U0aw8UmrkIwz2fNPvlKgh7sImPpYnD663iYl7NcChXmicpnXI/abpqEpawbpQEIHWKd4xA29y9jJ2DtqkejMHksFGrespIG9nnPihe2qu18uaUWwmCYOULSi5gsKaMbdp0Ab6XNRoT98l5cy5xZTZ9cdCNJgyugXJ8UTfuGtpnT3g+mAXacyO+rAAmEuMEgcKUEeC+aW+nCREhC5O1iWzL8uzdxeOT0lQqgykE0++CAaQzJU/Wq5Fojo4oY9P6pqw0Lo48h4Isz4vWxX8kdzzCMzH4Q3fKJQNNwiwdBXF96oXq2G8T9M+8n5WdAE3AUOqSqsVs111bqpiI7CzIX5tk4Loq/qaHl9uMyKJp9kTpYFLcK4gEBcsjafNE6/EKBpE8OgIkJ21Qw3bo5GmEUFuJtPVpLUVE1FkfF2+iXZX65Lvi4mpzg0tgWfGbO2x1AV3ULaKG1aUSb5YOhSSsELey8mphCX6px6+Qg06zI3t5rQa9O+39gszZGCjAFGzzopKaJ7nQP82VrVEuQR9n1B3C0QqZe65vxit5AIwjg4+eS9x90cIiXJe08IrG6aCOPiLyRuWhD6uZCwBqOW47WqqHoXXEvdAYos0iwCtRCHhLs3vcw/i1jqKpEwIVakJLAWMIqcJhmztmxg5tzmM9tYy+NP8obSmNXCt0BAXLI2nxXwDI5nhrNCfKsIaHcf4MOtFpUoIucFCXYuoG3tulkATtT9cUhW0ksDXcDjOKl14ZxgA0MEHI3UNMt8+m+VEHYJDNTlbs9zpMGjs2eLDpjvgv1tFhdOd4u9XcmWm1zAmEv3f5gd88ywYDv6HOO8YEgK6galzsjoQa0ER86NAKPmvOTJ5XcXLYogSyt7qyBTBzLWqtNzpPLR32sX1jh39P1UHgiBoRTgSJXyok0fG3IMPB7nCUm061VCGOSEHNqsmZIx4B1XbSHL3uGuS6gYftvGaFX944pwYEKzQEBcsjafC8cdi8aKsrdv94J8d39eSMvM/PKJbLd5iqyvCEKQjkXWFUxNHspM8FiUmxzT5gkB51sk2HY038aaJ9+iTtQMLBDRmTAGyq/CCUoUF2s//4hkhwBfyeYD6sKmaZ1q0ulITpQf1jhsaid1886swP1m96qtLnfeaJxS+Y/C0jHO6SL+PGlA9IGoL+L9ZcHHbeq3kouSVn8iBh8IqWO0sILL/fsfzw6Xi1fU6TIC4jHtN9Z2dKaQdV72T89gxg21ssmap+SUfRnzoNq"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 48,"totalTokenCount": 14119,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "8f565ff92386", "candidates": [{"content": {"parts": [{"text": " drives significantly easier and providing a superior driving experience.\n*   **Excellent HKG (Hyundai, Kia, Genesis) Support**: sunnypilot is highly regarded for its robust support for Hyundai, Kia, and Genesis vehicles, including features like Angle Steering"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 100,"totalTokenCount": 14171,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "d1", "candidates": [{"content": {"parts": [{"text": " (LFA2) and fixes/UI improvements for newer ccNC infotainment systems. The active involvement of sunnypilot maintainers who drive these vehicles ensures dedicated development in this area.\n*   **Dedicated Community and Development Team**:"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 148,"totalTokenCount": 14219,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "0ca3237b9d95", "candidates": [{"content": {"parts": [{"text": " Users frequently express appreciation for the sunnypilot team's dedication, the project's rapid progress, and the overall quality of development. The community itself is seen as a valuable resource.\n*   **Stability and Reliability**: sun"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 196,"totalTokenCount": 14267,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "bb54b3", "candidates": [{"content": {"parts": [{"text": "nypilot is valued for providing a stable platform, ensuring consistent safety compliance and reliability by fully adopting upstream comma.ai's openpilot, opendbc (car interface and safety), and panda test suites.\n*   **Unique Driving"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 245,"totalTokenCount": 14316,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "c066", "candidates": [{"content": {"parts": [{"text": " Experience**: The project aims to offer a unique driving experience through modified behaviors of driving assist engagements, tailoring the system to user preferences and vehicle capabilities.\n*   **Useful Features**: Features like the external USB storage are also appreciated by users for practical"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 294,"totalTokenCount": 14365,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "20", "candidates": [{"content": {"parts": [{"text": " benefits on long drives.\n*   **Driving Model Optimization**: sunnypilot provides various driving models and fosters discussions around them, allowing users to find the best fit for their car, controls, and road conditions.\n\nYou can find"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 342,"totalTokenCount": 14413,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "40", "candidates": [{"content": {"parts": [{"text": " more details in these topics:\n*   [Sunnypilot Raffle - Win a Free T-Shirt](https://community.sunnypilot.ai/t/sunnypilot-raffle-win-a-"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 390,"totalTokenCount": 14461,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "37", "candidates": [{"content": {"parts": [{"text": "free-t-shirt/840)\n*   [HKG Angle Steering (LFA2) - Imported Discussion from Discord](https://community.sunnypilot.ai/t/hkg-angle-steering"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 438,"totalTokenCount": 14509,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "c1e4f0a7ccd3", "candidates": [{"content": {"parts": [{"text": "-lfa2-imported-discussion-from-discord/327)\n*   [ccNC Port (Non-HDA2) — Supported Vehicles & Features](https://community.sunnypilot.ai/t/"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 488,"totalTokenCount": 14559,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "4216b6c0325f", "candidates": [{"content": {"parts": [{"text": "ccnc-port-non-hda2-supported-vehicles-features/1064)\n*   [I've always been curious about the team's development workflow](https://community.sunnypilot."}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 536,"totalTokenCount": 14607,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "f17c", "candidates": [{"content": {"parts": [{"text": "ai/t/ive-always-been-curious-about-the-teams-development-workflow/1127)\n*   [External storage/USB](https://community.sunnypilot.ai/t"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 585,"totalTokenCount": 14656,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "79cf0be619", "candidates": [{"content": {"parts": [{"text": "/external-storage-usb/728)\n*   [Understanding what sunnypilot is and how it works](https://community.sunnypilot.ai/t/understanding-what-sunnypilot"}],"role": "model"},"index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 633,"totalTokenCount": 14704,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}

data: {"nonce": "ffe7a71e", "candidates": [{"content": {"parts": [{"text": "-is-and-how-it-works/252)"}],"role": "model"},"finishReason": "STOP","index": 0}],"usageMetadata": {"promptTokenCount": 13328,"candidatesTokenCount": 648,"totalTokenCount": 14719,"cachedContentTokenCount": 991,"promptTokensDetails": [{"modality": "TEXT","tokenCount": 13328}],"cacheTokensDetails": [{"modality": "TEXT","tokenCount": 991}],"thoughtsTokenCount": 743},"modelVersion": "gemini-2.5-flash","responseId": "4sssabnMM-etz7IPlr-UqQk"}


Thanks, sorry I thought you were hosted by us :hugs: was going to offer to log in and help investigate.

Can you have a look in /logs are there any errors there. Looks like you are using the openai compatability endpoint for gemini, can you try the gemini one to see if the results are different?

1 Like

Nothing particularly calls my attention on the logs

(Sorry for the phone screenshots, I’ve been out for my bday the whole day but can’t let this one go hahahah)

I was unaware I was using this tho, but this is happening with any models… even ChatGPT ones or even gemini3. I use cloudflare’s AI gateway tho. But I’ve also tested without it and same result

Edit:

Regarding the compatibility endpoint… not sure if I’m doing it wrong but I don’t think I’m hitting the compatibility endpoint, I understand it ends in /openai but that’s not the case on mine. I’m sharing the config I have in case it throws a clue.

Also I have a feeling this also may have started happening when i enabled quotas but I’m not subject to them and this happens to models or assistants without quota. So it may be entirely coincidental too

that data you linked does not look like provider google data to me, it looks like provider openai to me, can you try flicking that over and see what happens?

Unfortunately setting it to provider OpenAI makes it fail (can’t ‘run test’), so provider google definitely makes it go through. I’ll remove cloudflare’s AI gateway to test ‘raw’ but what surprises me is that the data anyway is still being received completely by discourse tho , otherwise that response data I posted couldn’t be visible. I’m getting that when clicking in the “info” button and doing copy response

Edit:

Switching from cloudflare’s ai gateway to the api directly seems to have good results. I will keep monitoring and testing

1 Like