Thread

AI coding has made CI a bottleneck, so we reworked ours to keep up

317 points · 408 comments · julian_digital

dgroshev · 1790036731 · focus · HN ↗
I suspect a substantial part of this is an avalanche of useless testing.
If you even review PRs still: when was the last time you didn't just skip over tests? And if you ever looked at tests in an LLM-heavy PR, how many of those tests tested something useful, and not just built-ins and trivial behaviours?
There's at least some awareness in the industry of how LLMs generate a lot of boilerplate in business logic. It feels like we're much less aware of how much of it is in tests.
1. DanielHB · 1790077979 · focus · HN ↗
  To be fair they are also really good at fixing the tests and the whole point of a test is that when it breaks you need to take a look.
  It is more like looking at test diffs is more valuable than looking at new tests.
  But yeah, I wish people would clean up LLM-slop a bit and remove some useless tests, but I think this status quo is actually better than no tests at all.

Unofficial Hacker News client; not affiliated with Y Combinator.