This post by @codinghorror, How to block all crawlers but Google’s, gives info on both blocking and allowing bots. This may be what you’re looking for.
Probably, but that linked topic above is from July, 2019. 
This post by @codinghorror, How to block all crawlers but Google’s, gives info on both blocking and allowing bots. This may be what you’re looking for.
Probably, but that linked topic above is from July, 2019.