This is somewhere between bug and feature request, @Falco / @keegan
Our plan is to evict captions from markdown and layer them on, optionally and clearly afterwards to help with search and vision impaired users.
In the interim, yes you should certainly be able to permanently disable.