I’ve read a few different experiences with hosts having had success with Anubis to cut down on excessive scraping. One that comes to mind is the Dolphin project.[1]
I’ve read a few of those threads, but often it’s people at cross-purposes with the goals of Anubis. Is there a chance you could clarify the “not working” bit?
From a few weeks ago: <a href="https://news.ycombinator.com/item?id=49500040">https://news.ycombinator.com/item?id=49500040
Basically, the cost of an optimized solution is orders of magnitude lower than the cost of an in-browser solution. Anyone dedicated can easily afford to solve workloads higher than your users will tolerate.
You might stop casual scrapers, but you're not going to stop someone who cares. AI scraping companies care.
tech234a · · focus · HN ↗
stickfigure · · focus · HN ↗
danbolt · · focus · HN ↗
I’ve read a few of those threads, but often it’s people at cross-purposes with the goals of Anubis. Is there a chance you could clarify the “not working” bit?
[1] <a href="https://dolphin-emu.org/blog/2025/06/04/dolphin-progress-report-release-2506/" rel="nofollow">https://dolphin-emu.org/blog/2025/06/04/dolphin-progress-rep...
stickfigure · · focus · HN ↗
Basically, the cost of an optimized solution is orders of magnitude lower than the cost of an in-browser solution. Anyone dedicated can easily afford to solve workloads higher than your users will tolerate.
You might stop casual scrapers, but you're not going to stop someone who cares. AI scraping companies care.
hedora · · focus · HN ↗
[dead]