‹ BackHN Continuity

Thread

Meta's Muse is fantastic for web scraping

60 points · 74 comments · STRiDEX

  1. arjunchint · · focus · HN ↗
    their static ip's were initially good and didn't get flagged, but now most sites are recognizing their ip ranges and blocking.

    Muse's utility has significantly dropped with the blockages.

    To become truly useful again they will need to use residential proxies, but I can't see them use those due to the risks and reputational damage.

    1. sejje · · focus · HN ↗
      they can just use the user ip. i think grok already does this.
      1. koolala · · focus · HN ↗
        How can it do this? Wouldn't you see a hundred fetch requests in your browser network tab?
      2. arjunchint · · focus · HN ↗
        bruh have you heard of CSP?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.