Can you try Moonshot AI Kimi K2 via their API endpoints for China?
Looks like the base API URL is https://api.moonshot.cn/v1.
We embarked the structured outputs requirement because I had endured thousands of complaints of about issues such as, models adding “Here is your summary” or failures in parsing when getting a list of suggested titles for AI helper, etc. Now with translation, it became an even worse issue when you have to be able to trust millions of LLM invocations to not add anything extra to your output.
Given the need to reliability, and the general availability of structured outputs we made this call on the providers where it is supported, but I’d be open for a PR that adds a checkbox for disabling Structured Outputs from the API request on the OpenAI provider.