‹ BackHN Continuity

Thread

I built non-autoregressive decision models with RL a year ago

1363 points · 319 comments · nandakishor_ml

  1. Oras · · focus · HN ↗
    I played around with Jev last night and did it for classification tasks that I used Gemini 2.5 flash lite with.

    It’s a bit faster and bit cheaper, but this is compared to LLM. The consistency was nice to see, BUT, as someone who trained NLP models prior to LLMs, it’s just BERT with more data. I can see why people would want ready made one shot classifier, and I can see the value of sending multiple classifier in one call, but I wouldn’t call it breakthrough. And I believe many labs will replicate it in no time and might have it as part of their harness.

    I see it as a wake up call for the tech community to go back to basics for most tasks instead of relying solely on generic LLMs.

    1. tchalla · · focus · HN ↗
      Anyone who has worked in ML for 10+ years would already know that the usage of LLMs for everything is lazy, wasteful and a high degree of marketing on it.
      1. HappMacDonald · · focus · HN ↗
        I would rate using LLM for tasks more specific ML can handle as a lot like using one's smartphone to snap photos, listen to music, set alarms, and play video games in preference to carrying around a fun cam, ipod, watch, and switch 2 everywhere.

        For those who need to dive really deep into each specific avenue and squeeze maximal quality out, the photographers will be packing DSLRs and intense gamers will wait til they get home to strap into a PS5 or a gaming rig or VR or whatever.

        But "can get 90% of anyone's needs met in this field, and can do the same in dozens or hundreds of other fields simultaneously" will remain the killer solution for anyone with lots needs that each have bounded depth.

        1. genxy · · focus · HN ↗
          I prototyped an NLP pipeline using an LLM because setting up the whole NLP skeleton was way too much of a pain. It was able to adequately simulate each piece. The nice part was that I could attack the problem from above, at any point I could just have the full intelligence of the LLM at my disposal.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.