Robots.txt is not the answer: Proposing a new meta tag for LLM/AI

While Google is opening up the discussion on giving credit and adhering to copyright when training large language models (LLMs) for generative AI products, their focus is on the robots.txt file. However, in my opinion, this is the wrong tool to look at. My former colleague Pierre Far wrote an excellent article on Crawlers, search…

The post Robots.txt is not the answer: Proposing a new meta tag for LLM/AI appeared first on Content Krush.