‹ BackHN Continuity

Thread

AWS says it can't restore some data from mideast facilities struck by Iran

530 points · 452 comments · berkeleyjunk

  1. cmiles8 · · focus · HN ↗
    This interview with an AWS leader isn’t aging well, from CBS Sunday morning:

    Pogue asked, "I don't mean to give anyone ideas, but let's say I figured out that one of these unmarked buildings was an AWS data center, and I blew it up. Are you saying that it's so backed up and redundant that you probably wouldn't notice?" Wood replied, "Yeah, you wouldn't notice. I mean, we might be a bit upset, but you wouldn't notice!"

    <a href="https:&#x2F;&#x2F;www.cbsnews.com&#x2F;news&#x2F;cloud-computing-loudoun-county-virginia&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.cbsnews.com&#x2F;news&#x2F;cloud-computing-loudoun-county-...

    1. krick · · focus · HN ↗
      That is actually surprising to me. Claims like that are pretty common, they make sense and they should be true, so even though I don&#x27;t really know AWS (&#x2F;Backblaze&#x2F;Azure&#x2F;whatever) redundancy planning in enough detail, I used to trust them. It&#x27;s really worrying when they outright say it will be ok, and then a week later it turns out to be not ok.
      1. houssc · · focus · HN ↗
        The caveat is always &quot;if you&#x27;re using the service correctly&quot; which is not necessarily free. Meaning taking advantage of multiple geo zones, building in redundancy to your stack, etc. Like everything he said is possible if your technology stack living in AWS was designed to survive it. Everyone who has ever had the &quot;we lost your data&quot; email from AWS knows at the end of the day the cloud is just someone else&#x27;s data center with neat provisioning tools and services.
        1. jacquesm · · focus · HN ↗
          The problem is that lots of people seem to be under the impression that they are doing it right because they are using AWS. They don&#x27;t realize that AWS is a toolbox, not a &#x27;ready made solution for redundancy against all catastrophes you are possibly exposed to&#x27;. They use that to their advantage by pricing such solutions at a level that people will either pay through the nose or will be left without recourse when AWS loses their data. It&#x27;s stupid, but at the same time these beliefs are surprisingly wide spread.
          1. houssc · · focus · HN ↗
            Yep, a lot of non-technical leaders believe that &#x27;cloud&#x27; is synonymous with &#x27;DR strategy&#x27; or even &#x27;backup&#x27;. &quot;We won&#x27;t have to worry about being offline if our server goes down if we move to the cloud!&quot; Some of these people fundamentally don&#x27;t understand what the cloud is, their assumption is cloud means easy button that solves all your infrastructure and uptime problems.
            1. mhitza · · focus · HN ↗
              You are pointing the fingers at the wrong people. Cloud providers pushed this idea onto executives via their marketing and conferencing channels.

              Not disimilar to how AI naratives are pushed on executives these last two years.

              1. albert_e · · focus · HN ↗
                But alongside the marketing blitz they also offer certifications for people who are supposed to execute these projects. Even the most foundational certification exam -- which simply tests your recall on what AWS service is for compute versus networking -- teaches and tests you about &quot;Shared Responsibility Model&quot; that draws the line at what the customer is still responsible for when they use cloud bases IaaS &#x2F; PaaS &#x2F; SaaS services.

                If businesses are going to cloud but without engaging &#x2F; listening to competent people who know these basics -- then the blame needs to be somewhat pointed back at those very business leaders I feel.

                This is not obscure magical knowledge either that is tightly controlled. Any cloud vendor will freely teach you that. Or even a google search would.

                1. lelanthran · · focus · HN ↗
                  Who is a CEO going to believe? Amazon, Microsoft and the entire IT infra division or that lone SRE who disagrees with them?

                  I mean, every time cloud comes up on HN we see legions of techies posting strowman arguments about why you should offload everything onto AWS, GCP, Azure, etc.

                  1. avereveard · · focus · HN ↗
                    Aws cto is basically opening every presentation with a everything breaks all the time slide, idk where you get that idea they oversell the cloud resilience
                    1. silon42 · · focus · HN ↗
                      They could offer controlled &quot;failure of service&quot; service where they randomly take stuff offline and you have to pay to get it back if you don&#x27;t have a backup&#x2F;recovery strategy.
                      1. albert_e · · focus · HN ↗
                        AWS Fault Injection Service

                        <a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;fis&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;fis&#x2F;

                        <a href="https:&#x2F;&#x2F;docs.aws.amazon.com&#x2F;fis&#x2F;latest&#x2F;userguide&#x2F;what-is.html" rel="nofollow">https:&#x2F;&#x2F;docs.aws.amazon.com&#x2F;fis&#x2F;latest&#x2F;userguide&#x2F;what-is.htm...

                    2. scott_w · · focus · HN ↗
                      The customer CEO never watched that presentation.
                2. mitxela · · focus · HN ↗

                  [dead]

              2. rob74 · · focus · HN ↗
                You just have to take a look at the Rube Goldberg-esque abomination that is the AWS web interface for a few minutes to realize that it&#x27;s not that simple. Granted, most executives won&#x27;t do that...
                1. jaggederest · · focus · HN ↗
                  Or encounter their CLI and it&#x27;s lovecraftian combination of positional arguments, named arguments, piping, json documents, etc, distributed largely by random lot, as far as I can tell.
              3. jval43 · · focus · HN ↗
                No. If you&#x27;re the leader you should know what you&#x27;re leading. It&#x27;s literally the job.

                But the problem is right there: &quot;non-technical&quot; leaders. Never work for one if you can avoid it.

                1. IAmBroom · · focus · HN ↗
                  All Tesla employees reading this are fervently agreeing, between their tears.

                  &quot;We should build vacuum delivery tubes for passengers!&quot;

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.