I agree, the AI tag has a plugin icon so I assume it is meant for the AI plugin only. I’ve removed it.
Crawler content gets heavily cached so in practice I’ve never seen them to be able to DDoS.
Are you actually having performance issues because of this?