I just don’t honestly. Personal opinion, but LLMs have always been prohibited to visit my websites and always will. I don’t enjoy donating my hard work, whether that be text or code, to scrapers, especially that of OpenAI or Anthropic.
Most of my domains have files like this on them:
https://pyxfluff.dev/robots.txt
https://pyxfluff.dev/llms.txt
Obviously this is all just personal preference but this entire AI craze would be over once people stop allowing these companies to steal their websites content. Maybe the latest Google update people are so against will knock some sense into website owners who will now no longer have any hits to their site.