There is nothing Discourse specific here, so standard rules apply. A 7B model, if ran using fp16, will take ~14GB VRAM plus the space for the context. You can use fp8 quantization to halve that, but that old model isn’t the best for it.
As it isn’t feasible to ship every possible tokenizer, you should pick the closest one from the available tokenizers.