Found (and fixed) one more problem: if you set “AI auto image caption allowed groups” to the “everyone” group it will not automatically caption anything for anyone (regardless of the user’s setting) I had to explicitly set it to include all trust levels.
