Did you try it using OpenAI compatibility | Generative AI on Vertex AI | Google Cloud Documentation ?