This is a tough one.
We generally do not like to add too many knobs cause it confuses people but I hear you that this is hard to solve now, we may need another knob.
One option would be to allow the open ai compatible to have a “custom headers” section.
Tools could not easily solve this cause this would create an incredibly complex workflow and we don’t have the ability of easily passing all the information the tool needs.
@Falco thoughts?
Moving this to feature, cause it is a feature request.