‹ BackHN Continuity

Thread

S3 Is the Future, S3 Is the Past

79 points · 120 comments · tkhattra

  1. simonw · · focus · HN ↗
    One thing I find notable about S3 today is that, while it used to drop in price reasonably often, there hasn't been a price drop in a full decade:

      2006-03-14  $0.150/GB-month
      2010-11-01  $0.140/GB-month
      2012-02-01  $0.125/GB-month
      2012-12-01  $0.095/GB-month
      2014-02-01  $0.085/GB-month
      2014-04-01  $0.030/GB-month
      2016-12-01  $0.023/GB-month
    
    Today it's still $0.023/GB-month.
    1. charcircuit · · focus · HN ↗
      Egress pricing of $0.09/GB has been around for over a decade too.

      For reference transit cost has dropped over the years and is now about at $0.000247/GB or free if there is a peering agreement with the network the data is sent to.

      1. otterley · · focus · HN ↗
        Egress pricing pays for the AWS network infrastructure that is incredibly reliable (hardware failures happen regularly yet almost no one notices) and allows it to operate at scale sufficient to absorb even the largest DDoS attacks.

        This isn’t just AWS BTW; all tier 1 cloud providers recoup their costs this way.

        1. willtemperley · · focus · HN ↗
          Cloudflare R2 has zero egress fees.
          1. otterley · · focus · HN ↗
            CloudFlare is not a tier 1 cloud provider.
            1. willtemperley · · focus · HN ↗
              > CloudFlare is not a tier 1 cloud provider.

              Yes, you're legally correct, but the point is AWS are clearly overcharging for egress.

              As you say:

              > Egress pricing pays for the AWS network infrastructure that is incredibly reliable (hardware failures happen regularly yet almost no one notices) and allows it to operate at scale sufficient to absorb even the largest DDoS attacks.

              Cloudflare is also pretty good at absorbing DDoS attacks, yet charge no egress costs.

              Maybe the real question is, are the tier-1 providers colluding in overcharging for egress?

              1. otterley · · focus · HN ↗
                I don’t think we can say with certainty without knowing more details about their respective network investments. CloudFlare is architected quite differently than the others, and has a much less comprehensive service portfolio. It’s not an apples to apples comparison unless we’re strictly comparing S3 to R2. Choosing to charge less may also be a loss leader or a differentiation play.
                1. willtemperley · · focus · HN ↗
                  I think this underlines the core problem. It's really hard to make a fully informed choice of provider based on costs, and they deliberately make multi-cloud expensive.

                  Egress costs are fairly clearly a vendor lock in strategy. If I want to transfer 1TB to run on cheaper compute at another provider, that costs me $90 (edit) on AWS as opposed to $0.24 at wholesale prices. It's unlikely to be cost effective so I choose AWS compute.

                  EDIT: thanks to someonebaggy for pointing out my decimal point error.

                  Ninety dollars to transfer a terabyte is clearly ridiculous.

                  1. someonebaggy · · focus · HN ↗
                    It actually costs you $90 on AWS, not just $9
                    1. willtemperley · · focus · HN ↗
                      The latency is a bit higher, but IP over Avian Carrier would be cheaper than this.
              2. someonebaggy · · focus · HN ↗
                If they're charging what customers are willing to pay, are they overcharging? I think an axiom of capitalism is that that's the amount you should charge.

                Many people avoid T1 clouds because they're so expensive, but they seem to have found an extremely profitable market segmentation consisting of the remainder.

                1. Dylan16807 · · focus · HN ↗
                  If they were offering it in a competitive market without the special bundling factors, basically nobody would choose their egress. So yes they're overcharging, because they have control of your data.
        2. someonebaggy · · focus · HN ↗
          This is just Stockholm Syndrome. All T1 (except Cogent) and most T2 ISPs (that's most ISPs) are also very reliable, how much do they charge for transit?
          1. otterley · · focus · HN ↗
            You’re confusing an ISP with a tier 1 cloud provider. They are different animals altogether.

            And kindly refrain from accusing others of Stockholm Syndrome here. It’s incredibly rude.

            1. someonebaggy · · focus · HN ↗
              I am not confusing T1 ISPs with T1 clouds. When I said T1 ISPs, I meant T1 ISPs. Because those are really reliable ISPs (that you should probably not use as your ISP, for reasons irrelevant to the comparison).

              Finding any excuse to justify a 100x profit margin is a form of Stockholm syndrome.

              1. otterley · · focus · HN ↗

                [dead]

                1. someonebaggy · · focus · HN ↗
                  It really seems like you are using spurious accusations of impropriety to deflect from your actual point being bad.

                  We are comparing to T1 ISPs because they also provide huge amounts of bandwidth reliably, and they do it 3 orders of magnitude cheaper. Therefore it cannot possibly be the case that providing the bandwidth is simply that expensive.

                  1. otterley · · focus · HN ↗
                    Like I said: you are welcome to disagree with others. You are not welcome to insult them.

                    Many of us are aware that ISPs charge less for bandwidth. But they are not offering the same thing as a tier 1 cloud provider.

                    You may find these interesting:

                    <a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;video&#x2F;watch&#x2F;c37546e1558&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;video&#x2F;watch&#x2F;c37546e1558&#x2F;

                    <a href="https:&#x2F;&#x2F;cloud.google.com&#x2F;blog&#x2F;products&#x2F;networking&#x2F;speed-scale-reliability-25-years-of-data-center-networking" rel="nofollow">https:&#x2F;&#x2F;cloud.google.com&#x2F;blog&#x2F;products&#x2F;networking&#x2F;speed-scal...

                    1. someonebaggy · · focus · HN ↗
                      I&#x27;ll bite. What does AWS bandwidth provide that Arelion bandwidth doesn&#x27;t?
                      1. otterley · · focus · HN ↗
                        I updated my reply—please see the above links.

                        Again, these egress fees are not paying for egress alone. They are defraying the cost of operating a massive, complicated, low-latency, reliable cloud network infrastructure, much of which is free of charge when used internally.

                        Some, like you, are expecting that cloud providers operate on a “cost plus” model where what you pay is strictly based on what marginal costs for the same thing. But it’s not that simple in reality. Charges levied for one thing can be used to pay for another.

                        1. someonebaggy · · focus · HN ↗
                          The question was not answered. What does AWS bandwidth provide that Arelion bandwidth doesn&#x27;t?
                          1. otterley · · focus · HN ↗
                            The bandwidth itself? I’m honestly unsure as I don’t know how AWS’s interconnectivity and total bandwidth compares to Arelion. But it’s still the wrong question to ask.
                            1. someonebaggy · · focus · HN ↗
                              What is the right question to ask?
                              1. otterley · · focus · HN ↗
                                I think it’s “am I getting the value I expect for the price I pay?” If it’s not for you, that’s fine. But for others, it’s worth the cost. To them, they’re paying for more than mere egress bandwidth.
                                1. someonebaggy · · focus · HN ↗
                                  So basically it&#x27;s good as long as the consumer surplus is greater than zero, regardless of how the consumer surplus stacks up against the producer surplus?

                                  If it&#x27;s surplus it&#x27;s not costs. Why did you claim that the high price is to cover the costs if 99.9% of it isn&#x27;t covering the costs?

                                  If I may take the opposite view: companies should be grateful to get any profit from me at all.

                                  1. otterley · · focus · HN ↗
                                    &gt; If it&#x27;s surplus it&#x27;s not costs. Why did you claim that the high price is to cover the costs if 99.9% of it isn&#x27;t covering the costs?

                                    I edited my comment above to explain in more detail what these charges are covering (and it’s not egress bandwidth alone). This has been a fast moving conversation and I’ve tried to add more context, unfortunately after the fact. My bad for posting too quickly.

                                    1. Dylan16807 · · focus · HN ↗
                                      The things you listed don&#x27;t inflate costs 100x or 1000x.

                                      They could charge 10x-ish as much as T1 ISPs and cover all those costs and still have it be almost all profit.

                                      1. otterley · · focus · HN ↗
                                        Oh yeah? How do you know? Are you handling finances for a tier 1 cloud provider’s networking team?

                                        Show us the math.

                                        1. someonebaggy · · focus · HN ↗
                                          If you&#x27;re suggesting they really do have 1000x the costs of companies whose core business is internet, and yet they refuse to contract with those companies to deliver the service (they can still get 990x profit while still leaving 10x for the other company) in a rational market that would be a business-ending level of incompetence.

                                          It&#x27;s no different than if I&#x27;m selling apples for $1000 each. Even if I can find one or two customers willing to pay that, wouldn&#x27;t I have to be pretty stupid to spend $900 growing each apple incompetently when I could just spend $2 at the grocery store to fulfil those orders?

                                          1. otterley · · focus · HN ↗
                                            I’ve done the best I can with limited time and space to explain it here. If you still don’t understand or don’t care to learn how cross-subsidization works and the costs and business model of operating a tier 1 cloud provider and how they differ massively from operating an ISP, I don’t know what to tell you. Getting a job at one of these companies to gain that experience would be eye-opening for you.
                                            1. Dylan16807 · · focus · HN ↗
                                              If it&#x27;s cross-subsidization then that&#x27;s admitting it doesn&#x27;t cost very much!
                                    2. someonebaggy · · focus · HN ↗
                                      It&#x27;s funny that you say they are shifting costs around when AWS in particular is notorious for not doing that. Every individual thing they provide is metered and profitable.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.