Drunk & Root@sh.itjust.works to Selfhosted@lemmy.worldEnglish · 24 days agoHow to combat large amounts of Ai scrapers541226
116How to combat large amounts of Ai scrapersDrunk & Root@sh.itjust.works to Selfhosted@lemmy.worldEnglish · 24 days ago54
everytime i check nginx logs its more scrapers then i can count and i could not find any good open source solutions
Show ContentBahnd Rollard@lemmy.worldEnglish14·24 days agoWern’t there a few AI maze projects in the works? I wonder if running one of those for a bit will cause you to be added to an ignore list, clearly they dont respect your robots file.
Show Contentslazer2au@lemmy.worldEnglish17·24 days agoTar pits I think is the term they use to pollute AI data.
Wern’t there a few AI maze projects in the works? I wonder if running one of those for a bit will cause you to be added to an ignore list, clearly they dont respect your robots file.
Tar pits I think is the term they use to pollute AI data.