cm0002@lemmy.world to Technology@lemmy.worldEnglish · 1 month agoOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comexternal-linkmessage-square22fedilinkarrow-up1386arrow-down14cross-posted to: [email protected]
arrow-up1382arrow-down1external-linkOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comcm0002@lemmy.world to Technology@lemmy.worldEnglish · 1 month agomessage-square22fedilinkcross-posted to: [email protected]
minus-squaremesa@lemmy.worldlinkfedilinkEnglisharrow-up80·1 month agoYep same thing. I have some small servers and was getting hammered by openai ip controlled ai crawlers not respecting robots.txt. had to block all their IP addresses and create an AI black hole in order to stop them ddos ing my tiny site(s).
minus-squaretempest@lemmy.calinkfedilinkEnglisharrow-up47·1 month agoDid you not pay your protection money to CloudFlare?
minus-squareCosmic Cleric@lemmy.worldlinkfedilinkEnglisharrow-up34arrow-down7·1 month agoMan, this current age of AI really sucks. This comment is licensed under CC BY-NC-SA 4.0
minus-squareburghler@sh.itjust.workslinkfedilinkEnglisharrow-up16arrow-down1·1 month agoYou licensed your comment? You just saw first hand that AI crawlers don’t care about legal barriers.
minus-squareWhyJiffie@sh.itjust.workslinkfedilinkEnglisharrow-up6·1 month agoI suppose the goal isa kind of poisoning the well, in case at any time in the future it becomes enforceable somehow
minus-squareCosmic Cleric@lemmy.worldlinkfedilinkEnglisharrow-up3arrow-down3·1 month agoSome info about that … https://lemmy.world/post/26711096/15639879 This comment is licensed under CC BY-NC-SA 4.0
Yep same thing. I have some small servers and was getting hammered by openai ip controlled ai crawlers not respecting robots.txt. had to block all their IP addresses and create an AI black hole in order to stop them ddos ing my tiny site(s).
Did you not pay your protection money to CloudFlare?
Man, this current age of AI really sucks.
This comment is licensed under CC BY-NC-SA 4.0
You licensed your comment? You just saw first hand that AI crawlers don’t care about legal barriers.
I suppose the goal isa kind of poisoning the well, in case at any time in the future it becomes enforceable somehow
Some info about that …
https://lemmy.world/post/26711096/15639879
This comment is licensed under CC BY-NC-SA 4.0