‹ BackHN Continuity

Thread

S3 Is the Future, S3 Is the Past

79 points · 120 comments · tkhattra

  1. PunchyHamster · · focus · HN ↗
    > S3’s dominance is due to its many advantages: effectively infinite capacity, high durability, and low per-gigabyte capacity cost.

    It's not "cheap". 6 months of S3 is at around price of outright buying 4TB SSD at retail price. That before you do any IOPS to it

    S3 is terrible deal on any front. it's just easy

    1. acdha · · focus · HN ↗
      > It's not "cheap". 6 months of S3 is at around price of outright buying 4TB SSD at retail price. That before you do any IOPS to it

      This is badly misunderstanding the problem: S3 is a highly available service with geographic redundancy and a huge range of integrated features. Your comparison would need to be updated to include multiple running servers in addition to redundant storage, and the software stack implementing things like immutability, not to mention all of the security features.

      That’s not to say that you can’t build equivalents for the parts you use but you either need massive scale or giving up features to do that. For example, if you can tolerate bitrot or long access times if hardware fails, you can definitely get a lower cost per terabyte.

      The reason why most people don’t do that, even when they have scale, is that it adds cost and risk everywhere else if you need engineering/ops people working on storage. If you’re, say, the internet archive that might make sense—it’s quite literally why your organization exists—but most other places are going to see all of the integrated features that they don’t have to build and operate paying for the difference between S3 and physical media pricing. For example, if I want to process files as soon as they’re uploaded or have immutability, I can just turn that on rather than having to build more services.

      1. ehe78qhe · · focus · HN ↗
        Even if you factor that it, S3 is pretty expensive for most small to medium size data.
        1. acdha · · focus · HN ↗
          Try doing the math and ask why your time costs. You need to buy a lot of storage to pay for the engineering work and most places would prefer to spend that time and attention on the product rather than shaving a few percent off of the storage bill (especially since the savings will be negative for quite some time).
          1. aeonik · · focus · HN ↗
            Wait, I'm confused, are you arguing for or against S3? Did you mean factoring the time needed to obtain the multiple PhD levels of information in tracking the cost, usage, and security of those interoperable services plugged into S3?
            1. acdha · · focus · HN ↗
              I’m saying that once you make the fully-loaded comparison, the gap closes a lot and most places will choose to spend their time and attention elsewhere unless they have a truly massive storage need.
          2. elendilm · · focus · HN ↗
            Many of us just don't buy your argument. "Engineering work" for maintaining our own storage is not rocket science.

            You just plug it in and basically it runs. Thats pretty much it.

            Having to explain to an HN audience how installing an SSD is trivial is weird.

            1. acdha · · focus · HN ↗
              Again, this is completely misunderstanding the problem. Your single SSD with no redundancy, integrity, or security, or running servers competes with S3 in the same way that my backyard garden competes with local restaurants.
              1. elendilm · · focus · HN ↗
                You are shifting the goalpost.

                If you don't pay the premium for redundancy, your S3 is the same sitting duck as the single SSD in your office, albeit an expensive one. Thinking AWS and therefore integrity and security is magical thinking.

                Ask those who lost their data in Bahrain AWS.

                But you are entitled to your expensive opinion. Some of us just don't buy it is all.

                1. acdha · · focus · HN ↗
                  > You are shifting the goal-post.

                  No, that was literally the first paragraph of my original comment.

                  > If you don't pay the premium for redundancy, your S3 is the same sitting duck as the single SSD in your office, albeit an expensive one.

                  Again, this is misunderstanding what the service provides relative to raw storage. I suggest reading the documentation about reliability and thinking about how that SSD in your office fails to provide either geographic redundancy (which all but the one-zone flavor of S3 has) or bitrot protection. Similarly, while it is true that some security concerns still require you to configure things correctly, you should think about the infrastructure you would need to build to match the core service: none of that is something you can’t match but building and operating that has costs.

                  > Ask those who lost their data in Bahrain AWS.

                  Let’s think about this slightly longer: how is the SSD in your Bahrain office doing? Iran has to hit multiple AWS data centers to lose your S3 data so to match that you need to build a system which syncs changes at multiple separate campuses in the region, which is significantly more expensive, and when you realize that you probably want a copy somewhere far away, the work to build that will be more than checking a box — and don’t forget that you have to regularly test all of this to make sure you can trust it to work in a disaster.

                  Again, as readers of the original comment know, I’m not saying just you can’t do this but that it’s a category error to think the comparison is the raw hardware and not the combination of redundant hardware, software, and staffing you need to match capabilities. You can beat that with enough scale but that’s a very different equation.

                  1. elendilm · · focus · HN ↗
                    The original comment by PunchyHamster was about cost, i.e how AWS S3 base tier costs cannot be justified if you purchase your own SSD.

                    You shifted the conversation to redundancy and how AWS provides bells and whistles. You are consistent in your position, just not with me and not with PunchyHamster because we both are comparing costs by self hosting.

                    And for those of you who are willing to pay the premium and don't care about costs, like you, would obviously find AWS attractive.

                    For a startup like ours and many others, cost is everything. And spending a day or two for bitrot protection and having a couple of SSDs for redundancy and scalability is a no brainer.

                    You don't need big buildings for resilience. I suggest building things that require real scaling and resilience and you would know that it is about being distributed, having low cost, and owning your systems.

                    Your argument that it is expensive and tedious to maintain compared to AWS S3 is false. No it isn't.

                    Fear mongering only works against those who haven't built reliable systems. Building an S3 equivalent with cheap providers for redundancy or having one's own small resilient distributed hardware with staffing most often dwarfs the horribly insane premium paid for AWS S3 services.

                    But this is only if you want the redundancy which is a different topic altogether.

                    If all you want is a single replica, which was what PunchyHamster originally commented on, the base price of what AWS S3 provides, which does not include redundancy, makes even lesser sense compared to having your own SSD.

          3. ehe78qhe · · focus · HN ↗
            I have done the math as part of my job and often found that yes, it was literally worth the money to do our own storage in cases. Running a highly available, durable storage system is not particularly difficult. There was an era when it was a common skill for a sysadmin. In the current era there are off the shelf solutions for it, both open and proprietary.

            The biggest reason people pay for S3 is because of data transfer cost to other cloud services they are using.

            1. acdha · · focus · HN ↗
              Yes, I’ve also built those services. As I said before, it is totally possible to beat S3 on pricing but the margin narrows considerably when you factor in the full costs — e.g. think about how many places had replicated storage but not bit-rot protection or versioning and built that at the application layer instead — and the savings is often not big enough to make it your top engineering pick for the money & attention required.

              Fundamentally you’re playing a commodity game and that means you need a consistent edge to be worth the fixed costs. If your fully-loaded advantage is less than, say, 30% you’re better off negotiating with your AWS rep and investing your engineering resources in something your customers want.

            2. everfrustrated · · focus · HN ↗
              >Running a highly available, durable storage system is not particularly difficult

              Only someone who had never done this would say this.

              1. ehe78qhe · · focus · HN ↗
                I have done this both for myself and professionally for multibillion dollar companies. It's not that hard lol
          4. Dylan16807 · · focus · HN ↗
            > a few percent

            Really? No, it's not a few percent.

            1. acdha · · focus · HN ↗
              Again, spec out a multi-data center server + storage + staffing deployment and calculate the full cost per gigabyte. As I said earlier, if you buy enough storage you will definitely hit a level where you can beat S3 by a fair margin but many places never reach that point and many of the ones who do are going to have other projects which make more sense because they offer a high rate of return or provide something which isn’t a commodity.
              1. Dylan16807 · · focus · HN ↗
                That's a good argument that at a lower amount of storage you won't save money at all.

                This is very different from the idea that the savings are a few percent. In almost all cases the savings are nothing or a large fraction.

      2. elendilm · · focus · HN ↗
        Recent Iranian attacks on AWS locations in Bahrain resulted in loss of data that simply could not be recovered. <a href="https:&#x2F;&#x2F;www.infoq.com&#x2F;news&#x2F;2026&#x2F;09&#x2F;aws-middle-east-data-loss&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.infoq.com&#x2F;news&#x2F;2026&#x2F;09&#x2F;aws-middle-east-data-loss...

        Of course, if you had paid extra for the backups and redundancy, your data would survive.

        So to address your original point, unless you are paying extra for redundancy, it is cheaper if you use a 4TB SSD at retail price as the original commenter discussed.

        1. someonebaggy · · focus · HN ↗
          In this case AWS did not save you. AWS is supposed to be resilient against AZ failures within a region. Iran destroyed all AZs at once, so all the data was lost. If you had a hard drive in your office, either directly serving your project or as an off-site backup, you still have your data. In the end, was it worth paying several times as much for AWS to provide durability for you, only to have them lose the data anyway?
          1. elendilm · · focus · HN ↗
            You seem to have misunderstood. What you said is exactly my argument. I am with you :).

            The parent commentator is under the illusion that AWS automatically means security and scale and reliability.

            I was merely pointing out to him that Iranian attacks must serve as a wake up call for him.

          2. everfrustrated · · focus · HN ↗
            S3 has never been advertised as a DR strategy
            1. elendilm · · focus · HN ↗
              Focus on costs. That is the whole argument.
            2. someonebaggy · · focus · HN ↗
              it is advertised as eleven nines durability, however. That is better than anything you can build yourself, so if true, the best backup for your S3 bucket is an independent S3 bucket
        2. inkyoto · · focus · HN ↗

          [dead]

      3. someonebaggy · · focus · HN ↗
        Do you need that? If you want your own replicated storage cluster at home, you can use Ceph. I&#x27;ve seen Ceph deployed to utilize the spare hard drive ports in server clusters that otherwise mostly do compute (transcoding), alongside memcached to utilize the RAM, etc.

        I&#x27;d bet the majority of projects, but perhaps not the majority of traffic, can run adequately on a single server and tolerate a few hour maintenance window one weekend every month. Don&#x27;t waste money on overkill.

      4. PunchyHamster · · focus · HN ↗
        &gt; This is badly misunderstanding the problem: S3 is a highly available service with geographic redundancy

        First off, for geo-redundancy you need to pay extra, you only get region, and with recent strait crisis amazon already showed that can be hit and be unrecoverable.

        And you&#x27;re badly misunderstanding the point; that it is fucking expensive from every angle.

        You can get geo-redundancy cheaper (their competitions prove it all the time); you can get IOPS cheaper; and with massive difference in end of the month bill.

        Especially if you need a tons of bandwidth, S3 is very, very, very expensive way to get there.

        It might be acceptable if you just run a website, but once you start running data-heavy operations on it, a big SSD attached to server can be order of magnitude cheaper than running it on S3 (and you can still use it to backup the data in case something fails)

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.