# How to add a new Chat Bot connected to a self-hosted LLM?

**URL:** <https://meta.discourse.org/t/how-to-add-a-new-chat-bot-connected-to-a-self-hosted-llm/299791>\
**Category:** Development\
**Tags:** ai, ai-bot\
**Created:** [March 6, 2024, 11:18pm UTC](https://meta.discourse.org/t/how-to-add-a-new-chat-bot-connected-to-a-self-hosted-llm/299791 "2024-03-06T23:18:40Z")\
**Posts on this page:** 1\
**Showing post:** 12

<div class="post-metadata">

**Author:** ![Isambard](https://avatars.discourse-cdn.com/v4/letter/i/858c86/32.png) [@Isambard](https://meta.discourse.org/u/Isambard)\
**Post date:** [August 12, 2024, 10:19pm UTC](https://meta.discourse.org/t/how-to-add-a-new-chat-bot-connected-to-a-self-hosted-llm/299791/12 "2024-08-12T22:19:55Z")

</div>

I made an interesting discovery: the web server that I’m hosting my forum on has sufficient grunt to run a small LLM at modest speeds (6 tok/s without batching) even without a GPU. This will be useful for offline/background tasks.

---

_[View the full topic](https://meta.discourse.org/t/how-to-add-a-new-chat-bot-connected-to-a-self-hosted-llm/299791)._