How to use the hugging face llama2 chat bot

[JC_ICE (Sunice)]

how to use the hugging face llama2 chat bot?

[twofoursixeight]

Here is a guide that can help you set up the AI module on your forum:

Discourse AI - Self-Hosted Guide

You need over 16GB of free RAM, and plenty of CPU / GPU / Disk to spare to run those services. Also keep in mind that running those services are mildly complicated, and we are on a preview period where everything is changing quickly. This is a guide aimed at running your own instances of the services that power Discourse AI modules. Introduction If you want to use Discourse AI on your self-hosted instance, you may need to also run the companion services for the modules that you …

If you wish to give more context, go ahead, I can help with that

[Westcan]

New to Discourse and familiar with using the OpenAI API but looking to try to integrate Hugging Face in a self hosted version. I’ve setup an account with HuggingFace.co and have my API credentials but just wondering what other steps are required? And particularly where I find the other values for Hugging Face in Admin>Settings>Discourse AI?