‹ BackHN Continuity

Thread

Agents don't need memory, they need documentation

365 points · 261 comments · kmeh

  1. Garlef · · focus · HN ↗
    I think they even more so need deterministic feedback:

    I tried an approach based on the following idea recently and it's amazing - Lint rules where the error messages contain an explanation on how to deal with the issue.

    <a href="https:&#x2F;&#x2F;habit-hooks.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;habit-hooks.com&#x2F;

    I&#x27;m using it to foster IOSP (integration operation segregation principle) for example.

    1. fxtentacle · · focus · HN ↗
      Deterministic feedback is precisely how frontier models are trained. It’s called RLVR. You let the agent run on a problem and then calculate a deterministic score of how well it did. Repeat 1000x times and you can “brute force” a good solution. (Which includes all thinking traces and you add it to your training data.) And then a Chinese model can copy your advance for 1000x less compute. Which is why US labs call this not learning, but a distillation “attack”. It’s an attack on the business model.
      1. [deleted] · · focus · HN ↗

        [deleted]

      2. DelightOne · · focus · HN ↗
        Are there good open source setups that generate this training data automatically?

        Or is that the secret sauce no one wants to share, the edge people see themselves having.

        1. fxtentacle · · focus · HN ↗
          Labs typically pay $2k for each [prompt+scorer] docker image. So this is why frontier labs need so much cash and manpower and they see it as their moat.

          But some of the resellers have freebies, like:

          <a href="https:&#x2F;&#x2F;app.primeintellect.ai&#x2F;dashboard&#x2F;environments?ex_sort=by_sections" rel="nofollow">https:&#x2F;&#x2F;app.primeintellect.ai&#x2F;dashboard&#x2F;environments?ex_sort...

          <a href="https:&#x2F;&#x2F;github.com&#x2F;sierra-research&#x2F;tau2-bench" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;sierra-research&#x2F;tau2-bench

      3. balder1991 · · focus · HN ↗
        I suppose the same way that the normal programmers and artists would call LLMs an attack on licenses and copyright.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.