Internet traffic is up, and so are bots — they make up 56.5% of that traffic. But not everyone wants all the bots to see what they have, especially ChatGPT's bot.

ChatGPT’s crawler GPTBot, which spiders the internet to capture information and turn it into knowledge, is the most-blocked bot on the internet, according to Cloudflare’s 2025 year in review. Meanwhile its biggest rival, Google, is the No. 1 most-allowed crawler. And perhaps even more interestingly, while ChatGPT is the most-blocked bot, it’s actually Anthropic’s Claude AI engine that is the least reciprocally beneficial service for website owners.

Every year internet infrastructure company Cloudflare publishes an analysis of what’s happening on the internet.

Archive: http://archive.today/xvW1Q

Cite: https://radar.cloudflare.com/year-in-review/2025

  • givesomefucks@lemmy.worldEnglish
    21·
    14 hours ago

    Non-human bots now account for 56.5% of internet traffic

    Traffic, not content…

    But still, we’re getting there

    • kboy101222@sh.itjust.works
      English
      1·
      10 hours ago

      I wouldn’t be surprised if we’ve already passed that for new content. I can’t search for anything nowadays without it being clearly AI written garbage, especially for guides for video games.

      At least when someone on GameFAQs made some shit up it was a human being looking to troll you, not some statistical bullshit machine trying to generate page views for ad revenue