# About Discourse AI

**URL:** https://meta.discourse.org/t/discourse-ai/288617
**Category:** Support
**Tags:** ai
**Created:** [December 14, 2023, 6:44am UTC](https://meta.discourse.org/t/discourse-ai/288617 "2023-12-14T06:44:13Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![Chan\_Patrick](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/chan_patrick/32/264297_2.png) [@Chan\_Patrick](https://meta.discourse.org/u/Chan_Patrick)
#### Post date: [December 14, 2023, 6:44am UTC](https://meta.discourse.org/t/discourse-ai/288617/1 "2023-12-14T06:44:13Z")

</div>

Hello everyone, I have installed the Discourse AI plugin but have not been able to configure and use it! I have read the English version of the Discourse AI manual several times but still cannot grasp its configuration.  
Since I am self-hosting, do I need to set up AI myself using Docker! For example: toxicity

Thank you

---

<div class="post-metadata">

### Author: ![JammyDodger](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/jammydodger/32/254611_2.png) [@JammyDodger](https://meta.discourse.org/u/JammyDodger)
#### Post date: [December 14, 2023, 7:18am UTC](https://meta.discourse.org/t/discourse-ai/288617/2 "2023-12-14T07:18:04Z")

</div>

Have you also followed the necessary steps in [Discourse AI - Self-Hosted Guide](https://meta.discourse.org/t/discourse-ai-self-hosted-guide/259598)?

---

<div class="post-metadata">

### Author: ![Lhc\_fl](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/lhc_fl/32/268115_2.png) [@Lhc\_fl](https://meta.discourse.org/u/Lhc_fl)
#### Post date: [December 14, 2023, 8:19am UTC](https://meta.discourse.org/t/discourse-ai/288617/3 "2023-12-14T08:19:55Z")

</div>

Precisely, all the Processors mentioned in Module Providers for Discourse’s functionality require you to set up AI yourself using Docker.

That’s right. All the functions of `Processor: Discourse` mentioned in Module Providers require you to use docker to set up AI.

> [@Falco](#):
>
> ## Modules Providers
> 
> As we said above, we are committed to offer new AI features without compromising your privacy. See below the current providers and models for each module. CDCK handles hosting for open-source models in our infrastructure and API keys for SaaS providers like OpenAI:
> 
> | Module | Provider | Processor |
> | --- | --- | --- |
> | Toxicity | [UnitaryAI](https://github.com/unitaryai/detoxify) | Discourse |
> | Sentiment | [Emotion English DistilRoBERTa-base](https://huggingface.co/j-hartmann/emotion-english-distilroberta-base) | Discourse |
> | | [Twitter-roBERTa-base for Sentiment Analysis](https://huggingface.co/cardiffnlp/twitter-roberta-base-sentiment-latest) | Discourse |
> | NSFW | [GantMan - nsfw](https://github.com/GantMan/nsfw_model) | Discourse |
> | | [Open-NSFW 2](https://github.com/bhky/opennsfw2) | Discourse |
> | Semantic | [Sentence Transformers](https://github.com/UKPLab/sentence-transformers) | Discourse |
> | | [pgvector](https://github.com/pgvector/pgvector) | Discourse |
> | Composer | [OpenAI](https://platform.openai.com/) | Third party |
> | | [Anthropic](https://www.anthropic.com/) | Third party |
> | Summarization | [bart large cnn samsum](https://huggingface.co/philschmid/bart-large-cnn-samsum) | Discourse |
> | | [flan t5 base sansum](https://huggingface.co/philschmid/flan-t5-base-samsum) | Discourse |
> | | [long t5 tglobal base 16384 book summary](https://huggingface.co/pszemraj/long-t5-tglobal-base-16384-book-summary) | Discourse |
> | | [OpenAI](https://platform.openai.com/) | Third party |
> | | [Anthropic](https://www.anthropic.com/) | Third party |
> | AIBot | [OpenAI](https://platform.openai.com/) | Third party |
> | | [Anthropic](https://www.anthropic.com/) | Third party |
> 
> > 📣 Additional Discourse processor options for Composer / Summarization / AIBot are coming soon!

---

<div class="post-metadata">

### Author: ![Chan\_Patrick](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/chan_patrick/32/264297_2.png) [@Chan\_Patrick](https://meta.discourse.org/u/Chan_Patrick)
#### Post date: [December 14, 2023, 9:03am UTC](https://meta.discourse.org/t/discourse-ai/288617/4 "2023-12-14T09:03:07Z")

</div>

```plaintext
docker run -d --rm --gpus all --shm-size 1g -p 8080:80 -v /mnt:/data -e GPTQ_BITS=4 -e GPTQ_GROUPSIZE=32 -e REVISION=gptq-4bit-32g-actorder_True ghcr.io/huggingface/text-generation-inference:latest --model-id TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ --max-batch-prefill-tokens=12000 --max-total-tokens=12000 --max-input-length=10000 --quantize=gptq --sharded=true --num-shard=$(lspci | grep NVIDIA | wc -l | tr -d '\n') --rope-factor=2

```

Error response from daemon: could not select device driver “” with capabilities: [[gpu]].

---

<div class="post-metadata">

### Author: ![qianping\_chen](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/qianping_chen/32/448819_2.png) [@qianping\_chen](https://meta.discourse.org/u/qianping_chen)
#### Post date: [September 30, 2024, 5:20pm UTC](https://meta.discourse.org/t/discourse-ai/288617/5 "2024-09-30T17:20:52Z")

</div>

As painful as you, it’s too difficult, I don’t understand at all

---

<div class="post-metadata">

### Author: ![sam](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/sam/32/102149_2.png) [@sam](https://meta.discourse.org/u/sam)
#### Post date: [October 1, 2024, 5:42am UTC](https://meta.discourse.org/t/discourse-ai/288617/6 "2024-10-01T05:42:17Z")

</div>

Can you explain what you tried and what you are trying to achieve? (please reply in English - even if you use Google to translate)

---

<div class="post-metadata">

### Author: ![system](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/system/32/443519_2.png) [@system](https://meta.discourse.org/u/system)
#### Post date: [June 3, 2025, 9:57am UTC](https://meta.discourse.org/t/discourse-ai/288617/7 "2025-06-03T09:57:27Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
