Tea@programming.dev to Technology@lemmy.zipEnglish · edit-21 month agoCloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.blog.cloudflare.comexternal-linkmessage-square6linkfedilinkarrow-up150arrow-down10cross-posted to: technology@lemmy.mltechnology@lemmy.world
arrow-up150arrow-down1external-linkCloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.blog.cloudflare.comTea@programming.dev to Technology@lemmy.zipEnglish · edit-21 month agomessage-square6linkfedilinkcross-posted to: technology@lemmy.mltechnology@lemmy.world
minus-squaredraughtcyclist@lemmy.worldlinkfedilinkEnglisharrow-up5arrow-down1·1 month agoThis is amazing. The number of crawlers that don’t respect crawling directives is out of hand. Feed them garbage till they can’t pay their bills.
This is amazing. The number of crawlers that don’t respect crawling directives is out of hand. Feed them garbage till they can’t pay their bills.