WEB METADATA TO CONTROL LLM SCRAPING ACTUALLY BEING USED AS A THING YAAAY! Thanks for the reporting @benjedwards !
Also worth looking into ai.txt !
https://arstechnica.com/information-technology/2023/08/openai-details-how-to-keep-chatgpt-from-gobbling-up-website-data/