Thread

An update on Wayback Machine access

685 points · 362 comments · ChrisArchitect

tech234a · 1789497743 · focus · HN ↗
I wonder if they'll end up behind Anubis at some point. I'm surprised it hasn't happened already.
1. stickfigure · 1789498930 · focus · HN ↗
  Plenty of threads on HN about this, Anubis does not work.
  1. danbolt · 1789511296 · focus · HN ↗
    I’ve read a few different experiences with hosts having had success with Anubis to cut down on excessive scraping. One that comes to mind is the Dolphin project.[1]
    I’ve read a few of those threads, but often it’s people at cross-purposes with the goals of Anubis. Is there a chance you could clarify the “not working” bit?
    [1] <a href="https://dolphin-emu.org/blog/2025/06/04/dolphin-progress-report-release-2506/" rel="nofollow">https://dolphin-emu.org/blog/2025/06/04/dolphin-progress-rep...
    stickfigure · 1789518824 · focus · HN ↗
    From a few weeks ago: <a href="https://news.ycombinator.com/item?id=49500040">https://news.ycombinator.com/item?id=49500040
    Basically, the cost of an optimized solution is orders of magnitude lower than the cost of an in-browser solution. Anyone dedicated can easily afford to solve workloads higher than your users will tolerate.
    You might stop casual scrapers, but you're not going to stop someone who cares. AI scraping companies care.
    mitxela · 1789557370 · focus · HN ↗
    You're assuming that the part of Anubis that stops bots is the PoW. It's not.
    account42 · 1789560790 · focus · HN ↗
    The other parts are even more trivial for someone who cares to work around.
    mitxela · 1789562957 · focus · HN ↗
    "someone who cares" is the part that creates the firewall.
    stickfigure · 1789579690 · focus · HN ↗
    With modern AI tools, the amount you have to care is slight. Not much of a firewall. And the bad actors causing these scraping problems care a lot.
    mitxela · 1789601453 · focus · HN ↗
    Still have to care enough to run the ai

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.