‹ BackHN Continuity

Thread

An update on Wayback Machine access

685 points · 362 comments · ChrisArchitect

  1. simonw · · focus · HN ↗
    > Here’s what’s going on. The Internet Archive’s Wayback Machine has been hit by waves of high-volume automated traffic, and we’ve put protections in place to keep the service running.

    I'm pretty certain this is scrapers that are trying to workaround blocks on accessing original sites by hitting the Wayback Machine copy instead. Appalling behavior.

    In addition to the load it puts on this vital non-profit piece of Internet infrastructure, we've also already seen some sites opt out of the Wayback Machine to prevent their content from being scraped via this alternative route.

    1. pantsforbirds · · focus · HN ↗
      We used to always "scrape" the wayback machine for any sort of news article we actually paid to consume. I was absolutely shocked by major news sites making very important edits to an article without any sort of editorial notice!

      Sadly this sort of thing is probably not really possible anymore, but I can't really blame anyone for making this sort of decision. I can't imagine how much more traffic they get now vs 2021 when we were doing this.

      1. subarctic · · focus · HN ↗
        What if they charged money? Is it something you'd pay for?
        1. msephton · · focus · HN ↗
          I'd pay for it, but only if they implemented the changes the community of users have been requesting for years.
          1. carlosjobim · · focus · HN ↗
            No matter what they did, you'd have a new excuse for why you won't pay.
            1. msephton · · focus · HN ↗
              Ah, the old ad hominem attack. How refreshing.

              But anyway, no, I wouldn't keep finding reasons. I donate to them every year already. Somebody asked if I would be willing to pay and my answer was "yes, but".

              It would need to be improved because certain aspects of it suck right now, not only the error this post is about. They only need go as far as their forums and github repos to see the community feedback.

              1. carlosjobim · · focus · HN ↗
                If you're donating, then you are evidently willing to pay without any "buts". So aren't you arguing against your own actions?
                1. msephton · · focus · HN ↗
                  Not at all. I donate to Internet Archive, but we're talking here about paying for unobstructed access to but one part of their service: Wayback Machine. Two different things.
                  1. carlosjobim · · focus · HN ↗
                    100% of the people who write "I would pay, if..." or "I would pay, but..." are people who are never going to pay even a dime. You might be the exception, and sorry for bunching you up with them. You have paid already by donation.

                    I think that we should all pay when asked for things which we find useful, even if they aren't perfect. If nobody else is offering anything, then we have to take what's being offered. When there's a market, more providers will begin offering their versions.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.