• fjordo@feddit.uk
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    I wish these companies would realise that acting like this is a very fast way to get scraping outlawed altogether, which is a shame because it can be genuinely useful (archival, automation, etc).

    • jol@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      How can you outlaw something a company in another conhtinent is doing? And specially when they are becoming better as disguising themselves as normal traffic? What will happen is that politicians will see this as another reason to push for everyone having their ID associated with their Internet traffic.

      • MoogleMaestro@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        What will happen is that politicians will see this as another reason to push for everyone having their ID associated with their Internet traffic.

        You’re right. Which is exactly why companies should be exhibiting better behaviour and self regulate before they make the internet infinitely worse off for everyone.

  • Fijxu@programming.dev
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    AI scrapping is so cancerous. I host a public RedLib instance (redlib.nadeko.net) and due to BingBot and Amazon bots, my instance was always rate limited because the amount of requests they do is insane. What makes me more angry, is that this fucking fuck fuckers use free, privacy respecting services to be able to access Reddit and scrape . THEY CAN’T BE SO GREEDY. Hopefully, blocking their user-agent works fine ;)

    • enrich@programming.dev
      link
      fedilink
      English
      arrow-up
      1
      ·
      13 days ago

      I posted on your guestbook but the link was broken.

      I’d say be wary of Anubis author.

      I noticed you started using Anubis recently. Take a look here https://github.com/Xe/x/issues/701 also PRs 702, 703, 704

      -She made GNOME say something the project doesn’t agree
      -She tried to push her beliefs where it was unnecessary and disrespectful
      -She still refuses to remove things in her code that is disrespectful, some are mere comments and serves no real purpose
      -She refused to accept PRs, discuss changes, refuse dictionary definitions seemingly because of her ego
      -After all that she locked conversations in the issue/PRs as a result nobody else can show support now

      If she has a belief, there are other mediums/ways to express it, why like this?

      This is unwelcoming and definitely not FOSS spirit.