‹ BackHN Continuity

Thread

Meta's Muse is fantastic for web scraping

60 points · 74 comments · STRiDEX

  1. wiether · · focus · HN ↗
    As someone having to fight Meta's bots everyday to keep websites accessible to actual customers, I'm not surprised to read that it can be seen as something positive on the other side of the fence.

    But I'm wondering: at what cost?

    1. STRiDEX · · focus · HN ↗
      I think for my own side projects i would require the user to login if they were making requests from those ip addresses or block.
    2. Cakez0r · · focus · HN ↗
      The end game will be that either your site is fully open to bots and humans alike, or your site is open to humans only(×) and requires Airport security style identity verification.

      (×) and their AI delegates

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.