‹ BackHN Continuity

Thread

Salesforce Global Outage

280 points · 184 comments · mabil

  1. fhub · · focus · HN ↗
    Cause: Legacy Salesforce login service got into a resource-exhaustion cascade.

    Fix: Rolling some unspecified fix they proved in testing out over the fleet seemingly very slowly (After their earlier attempts to roll something out faster failed).

    Details at <a href="https:&#x2F;&#x2F;status.salesforce.com&#x2F;incidents&#x2F;20004433" rel="nofollow">https:&#x2F;&#x2F;status.salesforce.com&#x2F;incidents&#x2F;20004433

    1. dd8601fn · · focus · HN ↗
      I wonder if “legacy login” is the shared login gateway.

      It’s optional but everyone uses it. And it was flaky for an hour or so, like two months ago.

      1. kgermino · · focus · HN ↗
        And while I haven’t actually done my homework, the push to email-based login seems like it’s really pushing people to start using their own custom domains for logging in
    2. ubertaco · · focus · HN ↗
      Coincidentally, Salesforce just laid off the senior engineering lead on their shared login service team who 2 months ago was describing the practices his team follows to keep 99.95% uptime on that shared login service (this guy: <a href="https:&#x2F;&#x2F;www.linkedin.com&#x2F;posts&#x2F;patricktprice_engineeringmanagement-reliability-activity-7475257204628099075-LrN7" rel="nofollow">https:&#x2F;&#x2F;www.linkedin.com&#x2F;posts&#x2F;patricktprice_engineeringmana...)

      Layoffs are usually short-term money-savers at long-term cost, but hot damn this is the shortest short term I&#x27;ve ever seen.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.