Error in any AI Tool with no parameters, e.g. "tags"

sam · February 24, 2025, 5:37am

I have an eval for no param tools:

tool_calls/no_params_native.yml

34e238de9


      
          id: no_params_tool
          name: no_params_tool
          description: Eval to confirm that tool calls with no params work
          type: prompt
          args:
            stream: true
            system_prompt: "You are a helpful bot"
            message: "Look up the categories please"
            tools:
              -
                name: "categories"
                description: "Look up the categories"
          expected_tool_call:
            name: categories
            params: { }

And it passes with:

sam@arch evals % ./run -e no_params_tool
Running evaluation 'no_params_tool'
GPT-4o: Passed 🟢
GPT-4o-mini: Passed 🟢
Claude 3.5 Haiku: Passed 🟢
Claude 3.5 Sonnet: Passed 🟢
Gemini 2.0 Flash: Passed 🟢
Gemini 2.0 pro: Passed 🟢

Did you test on latest?

Topic		Replies	Views
AI Persona using Categories tool- "An empty string is not a valid JSON string" Bug ai , ai-bot	3	34	February 22, 2025
Custom ai tool fails Bug ai , ai-bot , fixed	2	75	July 17, 2024
Invalid request error in Google Flash Support ai	5	35	April 3, 2025
Unrecognized request argument supplied: tools Support ai , ai-bot	6	587	February 7, 2024
AI summarization not working after upgrading to 3.3.0 beta1 Support ai	11	621	April 19, 2024

Error in any AI Tool with no parameters, e.g. "tags"

Related topics