# Debugging adding new LLM

**URL:** <https://meta.discourse.org/t/debugging-adding-new-llm/321362>\
**Category:** Product Support\
**Tags:** ai\
**Created:** [August 13, 2024, 12:01am UTC](https://meta.discourse.org/t/debugging-adding-new-llm/321362 "2024-08-13T00:01:54Z")\
**Posts on this page:** 1\
**Showing post:** 1

<div class="post-metadata">

**Author:** ![Isambard](https://avatars.discourse-cdn.com/v4/letter/i/858c86/32.png) [@Isambard](https://meta.discourse.org/u/Isambard)\
**Post date:** [August 13, 2024, 12:01am UTC](https://meta.discourse.org/t/debugging-adding-new-llm/321362/1 "2024-08-13T00:01:54Z")

</div>

I’m trying to add a custom LLM to Discourse AI plugin. When I press the ‘test’ button I get “Internal Server Error”.

Is there a way of debugging this or getting a better error message? When I go into the docker image and curl the /v1/models, I’m able to fetch this correctly.

The model name is “models/Meta-Llama-3-8B-Instruct.Q6\_K.gguf” and I’m not sure whether there could be any issue with special characters.

---

_[View the full topic](https://meta.discourse.org/t/debugging-adding-new-llm/321362)._