Unexpected error in Forum Researcher

Saw the Forum Researcher Announcement and went to test it out…

But errored out for me with “unexpected characters after the JSON document (after ) at line 1, column 295”

Let me know if/what other info may be needed :slight_smile:

1 Like

Interesting, which llm are you using? Are you using xml tools or native tools? If you try a second time does it repeat?

We don’t have external LLMs connected (yet :sweat_smile:) - so tried with the CDCK Hosted Large LLM, which was available from the dropdown.

Not sure what you mean by “xml tools or native tools”

Ohh and it happened 3 times in separate question/chats

2 Likes

Oh that would be llama 70b, I don’t think it is powerful enough to run forum researcher unfortunately, will alert the team on the xml generation error, we may be able to fix it

1 Like

I imagined as much - I’d expect it not to be included in the dropdown if it’s a “built in model” but not powerful enough to work with it

1 Like

Yeah, I am a bit surprised our hosted LLM is unlocked for bots. We technically only rolled it out for summaries and AI search. Is there any chance you will be able to acquire Gemini/Anthropic or OpenAI keys internally?

There is a big motivation to do so from a “proving the value of community” perspective, as we would be able to help set you up with weekly/monthly reports that you could float upwards in the org.

Your site had access to it manually granted because you were part of an early test of the Discord integration feature.

If you want to test Researcher, please follow @sam’s advice and use a model like Gemini 2.5 Pro that does great with it.

1 Like