• Lvxferre@mander.xyz
    link
    fedilink
    English
    arrow-up
    32
    ·
    edit-2
    9 months ago

    Yup, it’s the same approach as email spam traps. Except the naughty list, but… holy fuck a shareable bot IP list is an amazing addition, it would increase the damage to those web crawling businesses.

    • Nighed@sffa.community
      link
      fedilink
      English
      arrow-up
      12
      ·
      9 months ago

      but with all of the cloud resources now, you can switch through IP addresses without any trouble. hell, you could just browse by IP6 and not even worry with how cheap those are!

      • Lvxferre@mander.xyz
        link
        fedilink
        English
        arrow-up
        12
        ·
        9 months ago

        Yeah, that throws a monkey wrench into the idea. That’s a shame, because “either respect robots.txt or you’re denied access to a lot of websites!” is appealing.