Can I add other AWS bedrock model providers as custom LLMs?

support
1

I am currently using AWS Bedrock with the Anthropic providers, and it works great, but I am wondering if there is a way to also add the other providers that AWS offers like Titan and Llama. I see there is a custom LLM option, but I’m not sure what to put in a few of the text boxes, like API key and URL since those are a little different for AWS Bedrock.

If anyone can provide clarification on this then that would be great!

1 Like
2

We are working on making our LLM configuration flexible enough that it will support any existing model given that it complies to any of the supported APIs, and we have already shipped part of this effort of making it possible to use any OpenAI-compatible API a few weeks ago, but we are still short of making this work with other APIs like Bedrock.

2 Likes