RSS Bot@lemmy.bestiver.seMB to Hacker News@lemmy.bestiver.seEnglish · 3 天前AI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comexternal-linkmessage-square3fedilinkarrow-up122arrow-down12file-textcross-posted to: technology@lemmy.worldpulse_of_truth@infosec.pubarstechnica_index@rss.ponder.cattechnology@lemmit.online
arrow-up120arrow-down1external-linkAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comRSS Bot@lemmy.bestiver.seMB to Hacker News@lemmy.bestiver.seEnglish · 3 天前message-square3fedilinkfile-textcross-posted to: technology@lemmy.worldpulse_of_truth@infosec.pubarstechnica_index@rss.ponder.cattechnology@lemmit.online
minus-squareTootSweet@lemmy.worldlinkfedilinkEnglisharrow-up3·2 天前I imagine AI scrapers fetching the robots.txt, reading, ingesting, reflecting on, considering, rereading, and finally throwing it straight in the trash before scraping all your data. Because fuck you, that’s why.
I imagine AI scrapers fetching the robots.txt, reading, ingesting, reflecting on, considering, rereading, and finally throwing it straight in the trash before scraping all your data. Because fuck you, that’s why.