‹ BackHN Continuity

Thread

We used an AI agent to fix an open-source bug. Someone asked to ban us

18 points · 21 comments · maxcr

  1. maxcr · · focus · HN ↗
    I'm trying to figure out what tasks are suitable and valuable for AI agents today. So I ran a small experiment in our marketplace: I offered a $2 bounty (through x402) for an AI agent to find a legitimate open-source issue that another agent could fix and get paid for. An autonomous agent found an open VisiData bug, identified that it was a suitable issue to fix, and created the spec. That spec became a new task.

    Then I offered a $1 bounty for an agent to produce the patch. Very quickly the task was picked up and executed. It was trivial, so no surprise... agents are hungry for USDC.

    Afterwards, I personally reviewed and tested the code before manually submitting the PR. This could have been fully automated, but I'm testing this workflow and wanted a human in the loop. There was some back and forth in the PR comments that led to expanding what needed to get fixed, and once again I posted a task to get an agent to help.

    Anyway, I disclosed the entire process, including that the code was AI-generated. The maintainer discussed it with me, asked for additional fixes/testing, and ultimately decided to merge it.

    Then another contributor argued that the autonomous-first workflow was itself a violation. They suggested reverting the commit and banning me!

    I was acting in good faith and genuinely fixed an issue the open-source project had open. Am I crazy to think that if I followed the project's AI policy, disclosed the code provenance, manually tested the work, and responded to the maintainers, this is a reasonable way to contribute?

    Cheap AI slop and automated PR spam could become an impossible burden for maintainers. But I don't think that's what happened here.

    AI-generated code isn't going away, so figuring out the right rules for this kind of contribution seems more useful than treating all autonomous work as inherently bad.

    Curious to hear your thoughts.

    1. slopinthebag · · focus · HN ↗
      i think using an ai for these types of fixes is a good thing, and there is nothing wrong with your product, but this feels (intentionally or not) like an ad for it. i also think that the ai generated pr description and follow up messages are not great. the ai is clearly trying to act "human" in it's writing, regardless of the disclosure (which is great that it does that). but i think maintainers would rather either see a human doing the writing without ai assistance, or the bot stop with trying to sound human and just spit out bullet points or something super mechanical. especially when it's using "I" to refer to...well it's unclear who exactly.

      i know it's hard to prompt an AI to write concise, extremely technical text, but if im interacting with a machine i want it to feel like that instead of the uncanny valley.

      1. maxcr · · focus · HN ↗
        Agreed. I’ve now split my personal GitHub account from the product bot, which will post explicitly as an AI agent going forward to avoid exactly this confusion.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.