UngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 1 year agoSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comexternal-linkmessage-square9fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comUngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 1 year agomessage-square9fedilink
minus-squarem-p{3}@lemmy.calinkfedilinkEnglisharrow-up0·1 year agoLemmy.ca added a block at the nginx level for it https://lemmy.ca/comment/1999439 # curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403
minus-squareThe Bard in Green@lemmy.starlightkel.xyzlinkfedilinkEnglisharrow-up1·1 year agoHilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…
Lemmy.ca added a block at the nginx level for it
https://lemmy.ca/comment/1999439
# curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403Hilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…