GPT-4 with vision available

At the moment gpt-4-turbo == gpt-4-0125-preview aka no vision.

@keegan is exploring some vision integration here:

Particularly adding captions to images via vision apis (both open and closed models)

I do really like the “demo” power of … starting a PM with bot, uploading an image and asking about it, but need to think through flow cause we would need to switch in and out of models.

Maybe a concept of “auto tool” can work here, so if we see an upload we automatically route to tool and then back to the main model… will have a think.

Technically wiring this up is not too complex within our architecture.

2 Likes