About Discourse AI

Support
1

Hello everyone, I have installed the Discourse AI plugin but have not been able to configure and use it! I have read the English version of the Discourse AI manual several times but still cannot grasp its configuration.
Since I am self-hosting, do I need to set up AI myself using Docker! For example: toxicity

Thank you

2 Likes
2

Have you also followed the necessary steps in Discourse AI - Self-Hosted Guide?

3

Precisely, all the Processors mentioned in Module Providers for Discourse’s functionality require you to set up AI yourself using Docker.

That’s right. All the functions of Processor: Discourse mentioned in Module Providers require you to use docker to set up AI.

1 Like
4 
docker run -d --rm --gpus all --shm-size 1g   -p 8080:80   -v /mnt:/data   -e GPTQ_BITS=4   -e GPTQ_GROUPSIZE=32   -e REVISION=gptq-4bit-32g-actorder_True   ghcr.io/huggingface/text-generation-inference:latest   --model-id TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ   --max-batch-prefill-tokens=12000   --max-total-tokens=12000   --max-input-length=10000   --quantize=gptq   --sharded=true   --num-shard=$(lspci | grep NVIDIA | wc -l | tr -d '\n')   --rope-factor=2

Error response from daemon: could not select device driver “” with capabilities: [[gpu]].

5

As painful as you, it’s too difficult, I don’t understand at all

6

Can you explain what you tried and what you are trying to achieve? (please reply in English - even if you use Google to translate)

7

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.