July 6, 2023 Google to explore alternatives to robots.txt in wake of generative AI and other emerging technologies