‹ BackHN Continuity

Thread

Security auditing in the age of (good enough) AI

94 points · 16 comments · aray07

Loading the complete thread in the background. This saved snapshot is available now. Refresh

  1. suhacker256 · · focus · HN ↗
    This is a great example of how we can actually be using AI to do things better, not just faster
    1. buu700 · · focus · HN ↗
      I'd argue that the difference is often just semantics. In general, I can do a better job on a given task in a week than a day. If I only have a day, but AI lets me do in that day what would have otherwise taken a week, then the result is better while my time expenditure remains constant.
      1. nullsanity · · focus · HN ↗

        [dead]

      2. code-sonar · · focus · HN ↗

        [dead]

  2. michaelastreiko · · focus · HN ↗

    [dead]

  3. Segv77 · · focus · HN ↗
    Good enough AI for security auditing feels like asking for "good enough" brakes. There's just no room for complacency.
    1. fovc · · focus · HN ↗
      Not sure I follow the analogy, so apologies if I'm reading it backwards, but we do in fact have standards for "good enough" brakes without being brake-maxxers.

      Similarly here, I'd argue that a verified implementation with correctness proofs, mechanical translation, and easily auditable theorems seems close to good enough? A lot rides on the Claude-built translator, I suppose, but the trusted code for that project seems to be tiny in comparison to what it would have been 2 years ago!

      1. thephyber · · focus · HN ↗
        I suspect you two are using the same words for different terms / connotations.

        "Good enough" in colloquial speak usually means the minimum required for some particular requirement.

        For security, there is usually no exact threshold that differs between insecure and secure. It's a spectrum that involves costs and tradeoffs, which are subjective value judgements.

        A SaaS startup in pre-seed mode with no customers will have VASTLY different value judgements than a bank that handles $trillions in assets. Hence they will make very different security choices and "good enough" will mean very different things in their different sectors.

      2. jessebldr · · focus · HN ↗

        [dead]

    2. aftbit · · focus · HN ↗
      I don't get the analogy. Brakes that are good enough for a Honda Civic driven at regular speeds are not good enough for a fire truck or a race car, but there are in fact standards that are "good enough" for all of those.
      1. firen777 · · focus · HN ↗
        People on HN have a tendency to shove in analogies where it doesn't need one. Even worse when most of the time the analogies do not make sense.
        1. ethersteeds · · focus · HN ↗
          You could even say we are like a glass carpet: the color may be attractive but the texture is terrible...
    3. PostOnce · · focus · HN ↗
      There is an area where an AI audit can add some real value: the huge multitude companies that have never looked at security at all. Small businesses.
    4. bravetraveler · · focus · HN ↗
      This is why we all use ceramics, of course.
    5. conception · · focus · HN ↗
      All security is a negotiation of allocating resources. It always ends with “well, that’s good enough for this.” There is never a “Ahhhh we’re done!” It can always be “more secure”.
  4. Ozzie-D · · focus · HN ↗

    [dead]

  5. AndrewKemendo · · focus · HN ↗
    It’s over security people

    You need to find a new way to do business with the assumption that you’re 100% eventually going to get pwned

    So just assume that going forward and you’ll start to rethink your architecture

    1. Cider9986 · · focus · HN ↗
      [delayed]
      1. AndrewKemendo · · focus · HN ↗
        All valid.

        Overall though the point is any particular hole that you have will be exploited

        so what used to be a game of “patch the hole” is going to need to change entirely

    2. s0rrymybad · · focus · HN ↗

      [dead]

    3. MattPalmer1086 · · focus · HN ↗
      Haha, we are ahead of you. We realised we were gonna get owned a long time ago, since business and engineering teams prioritised speed over security. And also that it is genuinely hard to secure everything.

      This is why there are so many resilience initiatives in serious organisations. Assume it is gonna happen. Limit blast radius, ensure effective recovery.

    4. shakna · · focus · HN ↗
      [delayed]
  6. ZeroDayDreamer · · focus · HN ↗

    [dead]

  7. portagescout · · focus · HN ↗

    [dead]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.