Ran face-first into a brick wall of not knowing what the hell I’m doing in trying to get this working on an EC2 instance without a GPU. At least to the best of my extremely limited abilities and understanding here, trying to do this with a CPU-only instance means a lot more configuration work than I can understand. The cpu versions of ghcr.io/huggingface/text-embeddings-inference refuse to load either of the two listed models; Claude and GPT5 both tell me I need to convert them to ONNX models with a bunch of python tools, and that’s where I noped out.
(It’s also very possible I’m just dumb and missing an obvious step!)