‹ BackHN Continuity

Thread

If AI coding is lowering your code quality, you're not managing quality right

129 points · 169 comments · bucket2015

  1. fishfasell · · focus · HN ↗
    I think there's a lot of setup and context required for an AI agent to consistently write good code. Once the agent has these guard rails in place I usually get great quality- far better than what I would write in most cases.

    I think where things get dicey is being able to write in any language. I write and review code in many languages and frameworks I'm not fluent in, so it's hard for me to distinguish between working code and great code. I can spot when the fundamental logic is wrong, but when it comes to "best fit" choices I'm clueless.

    1. this_user · · focus · HN ↗
      The issue is that in order to have the agent write good code, you need to implement standard SWE best practices. But that also means a lot of manual intervention in terms of writing specs, checking acceptance criteria, and reviewing code. So you end up spending a lot of time on managing your agent, which means you won't get a 1000% productivity gain, you get maybe 50 or 100, possible less in some areas and with some issues.
      1. beezlewax · · focus · HN ↗
        50 or 100 seems unlikely. Even with all these improvements, custom setups and guardrails it just isn't that much faster for me.
      2. user43928 · · focus · HN ↗
        A 1000% productivity gain is quite possible on solo greenfield projects.

        At work, with a team and code reviews, the 50%-100% figure seems much more likely.

        This can probably move towards the more spectacular productivity gains as the AI's output becomes more reliable, people realize this, and less time is spend on code review and cleaning up the output.

      3. lolakutty · · focus · HN ↗
        > implement standard SWE best practices

        The thing is, if you follow SWE best practices indiscriminately, then you ll have a shit code base in no time.

        There is no silver bullet, and no replacement for experience and mindfulness.

      4. bigstrat2003 · · focus · HN ↗
        You get 0% productivity gains if you are careful and actually reviewing the code the LLM produces. The only way to actually get the massive productivity gains that AI bros claim is to throw quality out the window.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.