cm0002@lemmy.world to Opensource@programming.dev · 4 months agoAnubis - Weighs the soul of incoming HTTP requests to stop AI crawlersgithub.comexternal-linkmessage-square8fedilinkarrow-up172arrow-down12
arrow-up170arrow-down1external-linkAnubis - Weighs the soul of incoming HTTP requests to stop AI crawlersgithub.comcm0002@lemmy.world to Opensource@programming.dev · 4 months agomessage-square8fedilink
minus-squareisolatedscotch@discuss.tchncs.delinkfedilinkarrow-up3·4 months agoai scrapers send thousands of requests per second, they’ll just deem a small website using it “not worthy”
ai scrapers send thousands of requests per second, they’ll just deem a small website using it “not worthy”