Cloudflare is now offering a feature called “AI labyrinth” where it serves a series of AI generated pages to AI crawlers that ignore robots.txt directives.
They’re essentially serving AI slop to AI crawlers that are training off of a website’s content without permission.
Deliciously devious. 😈
They’re essentially serving AI slop to AI crawlers that are training off of a website’s content without permission.
Deliciously devious. 😈
Comments
How do they know it’s a crawler though?
Either get permission or your AI gets degraded.