‹ BackHN Continuity

Thread

AI coding has made CI a bottleneck, so we reworked ours to keep up

317 points · 408 comments · julian_digital

  1. dgroshev · · focus · HN ↗
    I suspect a substantial part of this is an avalanche of useless testing.

    If you even review PRs still: when was the last time you didn't just skip over tests? And if you ever looked at tests in an LLM-heavy PR, how many of those tests tested something useful, and not just built-ins and trivial behaviours?

    There's at least some awareness in the industry of how LLMs generate a lot of boilerplate in business logic. It feels like we're much less aware of how much of it is in tests.

    1. sz4kerto · · focus · HN ↗
      > If you even review PRs still: when was the last time you didn't just skip over tests?

      The opposite. Reviewing PRs is now about just reviewing the tests, as the code is very likely to be fine if tests are relevant and they're passing.

      The main enabler of agentic coding is heavy end-to-end/characterisation testing.

      We can ask AI to do very large-scale refactors, for example, because if tests pass, it's 99% that everything is fine.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.