Saw the Forum Researcher Announcement and went to test it out…
But errored out for me with “unexpected characters after the JSON document (after ) at line 1, column 295”
Let me know if/what other info may be needed 
AI-generated summary
A user reported an “unexpected characters after the JSON document” error while testing the Forum Researcher feature, which uses a hosted LLM. The issue occurred multiple times across different chats. The team clarified that the available LLM (Llama 70b) is not powerful enough to run the feature, and the model was only accessible due to the user’s participation in an early test. The user was advised to use a more capable model like Gemini 2.5 Pro. The team acknowledged the bug and confirmed that the issue can be closed.
2 Likes
Interesting, which llm are you using? Are you using xml tools or native tools? If you try a second time does it repeat?
We don’t have external LLMs connected (yet 
) - so tried with the CDCK Hosted Large LLM, which was available from the dropdown.
Not sure what you mean by “xml tools or native tools”
Ohh and it happened 3 times in separate question/chats
2 Likes
Oh that would be llama 70b, I don’t think it is powerful enough to run forum researcher unfortunately, will alert the team on the xml generation error, we may be able to fix it
1 Like
I imagined as much - I’d expect it not to be included in the dropdown if it’s a “built in model” but not powerful enough to work with it
1 Like
Yeah, I am a bit surprised our hosted LLM is unlocked for bots. We technically only rolled it out for summaries and AI search. Is there any chance you will be able to acquire Gemini/Anthropic or OpenAI keys internally?
There is a big motivation to do so from a “proving the value of community” perspective, as we would be able to help set you up with weekly/monthly reports that you could float upwards in the org.
Your site had access to it manually granted because you were part of an early test of the Discord integration feature.
If you want to test Researcher, please follow @sam’s advice and use a model like Gemini 2.5 Pro that does great with it.
1 Like
Is there anything remaining to be done here or can we close this bug report?