關於Discourse AI Discussion Summary
The discussion revolves around self-hosting and using Discourse AI with Docker. Chan_Patrick initially shared their struggle in setting up Discourse AI, despite reading the English documentation. They asked if they needed to use Docker to set up AI for features like toxicity.
Lhc_fl confirmed that all Processor: Discourse functions require Docker setup. JammyDodger suggested following the necessary steps in the Discourse AI self-hosted guide.
Chan_Patrick later shared a Docker command they tried to run, but encountered an error. qianping_chen empathized with their struggle, finding it difficult to understand. sam asked Chan_Patrick to explain what they tried and what they aim to achieve, requesting a response in English.
Hello everyone, I have installed the Discourse AI plugin but have not been able to configure and use it! I have read the English version of the Discourse AI manual several times but still cannot grasp its configuration.
Since I am self-hosting, do I need to set up AI myself using Docker! For example: toxicity
Thank you
Have you also followed the necessary steps in Discourse AI - Self-Hosted Guide?
Precisely, all the Processors mentioned in Module Providers for Discourse’s functionality require you to set up AI yourself using Docker.
That’s right. All the functions of Processor: Discourse mentioned in Module Providers require you to use docker to set up AI.
docker run -d --rm --gpus all --shm-size 1g -p 8080:80 -v /mnt:/data -e GPTQ_BITS=4 -e GPTQ_GROUPSIZE=32 -e REVISION=gptq-4bit-32g-actorder_True ghcr.io/huggingface/text-generation-inference:latest --model-id TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ --max-batch-prefill-tokens=12000 --max-total-tokens=12000 --max-input-length=10000 --quantize=gptq --sharded=true --num-shard=$(lspci | grep NVIDIA | wc -l | tr -d '\n') --rope-factor=2
Error response from daemon: could not select device driver “” with capabilities: [[gpu]].
As painful as you, it’s too difficult, I don’t understand at all
Can you explain what you tried and what you are trying to achieve? (please reply in English - even if you use Google to translate)