大家好，本人安裝了Discourse AI插件但未能設定和使用！本人閱讀了好幾次英文版Discourse AI 說明書但也未能掌握其設定。因本人是self-hosting ，哪我是不是需要自行用docker 架設AI ! 例如：toxicity 謝謝

Have you also followed the necessary steps in Discourse AI - Self-Hosted Guide?

正是如此，Module Providers里提到的所有Processor为Discourse的功能都需要自己用docker架设AI That’s right. All the functions of Processor: Discourse mentioned in Module Providers require you to use docker to set up AI. [תמונה]Discourse AI Modules Providers As we said above, we are committed to offer new AI features without compromising your privacy. See below the current providers and models for each module. CDCK handles hosting for open-source models in our infrastructure and API keys for SaaS providers like OpenAI: Module Provider Processor Toxicity UnitaryAI Discourse Sentiment Emotion English DistilRoBERTa-base Discourse Twitter-roBERTa-base for Sentiment Analysis Discourse NSFW GantMan - nsfw Discourse Open-NSFW 2 Discourse Semantic Sentence Transformers Discourse pgvector Discourse Composer OpenAI Third party Anthropic Third party Summarization bart large cnn samsum Discourse flan t5 base sansum Discourse long t5 tglobal base 16384 book summary Discourse OpenAI Third party Anthropic Third party AIBot OpenAI Third party Anthropic Third party :mega: Additional Discourse processor options for Composer / Summarization / AIBot are coming soon!

docker run -d --rm --gpus all --shm-size 1g -p 8080:80 -v /mnt:/data -e GPTQ_BITS=4 -e GPTQ_GROUPSIZE=32 -e REVISION=gptq-4bit-32g-actorder_True ghcr.io/huggingface/text-generation-inference:latest --model-id TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ --max-batch-prefill-tokens=12000 --max-total-tokens=12000 --max-input-length=10000 --quantize=gptq --sharded=true --num-shard=$(lspci | grep NVIDIA | wc -l | tr -d '\n') --rope-factor=2 Error response from daemon: could not select device driver “” with capabilities: [[gpu]].

和你一样痛苦, 实在太难了, 完全搞不懂

על Discourse AI

תמיכה

sam (Sam Saffron) 1 באוקטובר,‏ 2024,‏ 5:42am 6

Can you explain what you tried and what you are trying to achieve? (please reply in English - even if you use Google to translate)

נושא		תגובות	צפיות
I want to install Discourse AI on Discourse Self-hosting ai	12	790	19 במאי,‏ 2024
Discourse AI - Self-Hosted Guide Self-Hosting ai	59	15414	20 במאי,‏ 2024
Introducing Discourse AI Blog	26	4588	4 במאי,‏ 2023
Self-Hosting an OpenSource LLM for DiscourseAI Self-Hosting ai	12	4613	6 ביולי,‏ 2026
Self-Hosting Sentiment and Emotion for DiscourseAI Self-Hosting ai , ai-sentiment	17	1888	12 באוגוסט,‏ 2026

על Discourse AI

נושאים קשורים