‹ BackHN Continuity

Thread

I built non-autoregressive decision models with RL a year ago

1363 points · 319 comments · nandakishor_ml

  1. Oras · · focus · HN ↗
    I played around with Jev last night and did it for classification tasks that I used Gemini 2.5 flash lite with.

    It’s a bit faster and bit cheaper, but this is compared to LLM. The consistency was nice to see, BUT, as someone who trained NLP models prior to LLMs, it’s just BERT with more data. I can see why people would want ready made one shot classifier, and I can see the value of sending multiple classifier in one call, but I wouldn’t call it breakthrough. And I believe many labs will replicate it in no time and might have it as part of their harness.

    I see it as a wake up call for the tech community to go back to basics for most tasks instead of relying solely on generic LLMs.

    1. kianN · · focus · HN ↗
      The data labeling objection baffles me. Even if you don’t need labels for training, how do you know your model is working if you’re not evaluating it?

      My company specializes in statistical long document text classification, but nowadays we mainly work with audit trail requirements because we got tired of hearing complaints about our 5 example learning curve. Seems like the industry standard is telling an llm to label and telling an llm to eval, and crossing your fingers that it’s correct.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.