# Riguardo a Discourse AI

**URL:** <https://meta.discourse.org/t/discourse-ai/288617>\
**Category:** Support\
**Tags:** ai\
**Created:** [14 Dicembre 2023, 6:44am UTC](https://meta.discourse.org/t/discourse-ai/288617 "2023-12-14T06:44:13Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![Chan\_Patrick](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/chan_patrick/32/264297_2.png) [@Chan\_Patrick](https://meta.discourse.org/u/Chan_Patrick)\
**Post date:** [14 Dicembre 2023, 9:03am UTC](https://meta.discourse.org/t/discourse-ai/288617/4 "2023-12-14T09:03:07Z")

</div>

```plaintext
docker run -d --rm --gpus all --shm-size 1g -p 8080:80 -v /mnt:/data -e GPTQ_BITS=4 -e GPTQ_GROUPSIZE=32 -e REVISION=gptq-4bit-32g-actorder_True ghcr.io/huggingface/text-generation-inference:latest --model-id TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ --max-batch-prefill-tokens=12000 --max-total-tokens=12000 --max-input-length=10000 --quantize=gptq --sharded=true --num-shard=$(lspci | grep NVIDIA | wc -l | tr -d '\\n') --rope-factor=2

```

Risposta di errore dal demone: impossibile selezionare il driver del dispositivo “” con capacità: [[gpu]].

---

_[View the full topic](https://meta.discourse.org/t/discourse-ai/288617)._