Please, I need help with the manual configuration of VLLM in the AI model section admin/plugins/discourse-ai/ai-llms/new?llmTemplate=none.

Sure, what exactly are you struggling with in there?

I’m unsure about these two options and how to utilize them, specifically in relation to the API. URL of the service hosting the model Tokenizer

[صورة] Olajuwon: URL of the service hosting the model That is the hostname of the machine where you are running vLLM. It may also work with an IP in the form of http://1.1.1.1:1111 but I have not tested it as such. [صورة] Olajuwon: Tokenizer We have a few tokenizers to helps us limit …

OMG, this is too complex for me atm, would go with Sambanova Instead!

تكوين يدوي لـ VLLM

الدعم

Falco (Falco) 11 أكتوبر 2024، 8:04م 2

بالتأكيد، ما الذي تواجهه صعوبة فيه بالضبط؟

الموضوع		الردود	مرات العرض
Debugging adding new LLM Support ai	8	351	23 أغسطس 2024
Self-Hosting an OpenSource LLM for DiscourseAI Self-Hosting ai	7	3525	20 يناير 2026
Discourse AI - Large Language Model (LLM) settings page Site Management ai , how-to	20	3074	26 نوفمبر 2025
创建可用的llm后也无法设置 AI default LLM model Support ai	3	25	20 مارس 2026
Adding Semantic Search feature for our self-hosted discourse site Support ai , ai-search	9	233	19 مارس 2025

تكوين يدوي لـ VLLM

الموضوعات ذات الصلة