‹ BackHN Continuity

Thread

Jeff – Jev-compatible 0.8B decision models, trained at home, ~30 ms

575 points · 225 comments · firelex

  1. AgentMasterRace · · focus · HN ↗
    I compared it to Jev in my current use cases and it's very inaccurate. 70% vs 94% . for classification, it's unacceptable.
    1. tbeseda · · focus · HN ↗
      For _your_ classification it's unacceptable. The OP seems to have anticipated this and mentions you can fine tune it for your use case. Did you try that?

      I don't think the point is to displace Jev, but to show it's possible to build an MVP on open weights without years of work and millions of dollars.

      Why (presumably) an engineer would dismiss exploring a lightweight, custom alternative to locking into a fashionable PaaS, I'll never know.

      1. senko · · focus · HN ↗
        > The OP seems to have anticipated this and mentions you can fine tune it for your use case. Did you try that?

        You can already so that with classification models such as ModernBERT, at 0.4B.

        Jev's value is its zero shot performance without having to fine-tune.

        1. beepbooptheory · · focus · HN ↗
          I am sure I am missing something obvious here, but why is that valuable? Like, what kinds of projects are there where you need to classify stuff but are unable to make a bespoke model targeting the specific problem?
          1. vickychijwani · · focus · HN ↗
            Tons. For example, most web and mobile app developers won’t know where to start with making a bespoke model (and would likely have no interest in making one), but they will have lots of usecases for a classifier.
            1. retinaros · · focus · HN ↗
              its a 1 hour project on claude code on ur local machine. lol...
              1. vickychijwani · · focus · HN ↗
                Only for folks who already know what they’re doing.

                What I said will only make sense if you take yourself out of your current context and think entirely from the perspective of someone who knows little-to-nothing about ML.

                It’s the same mistake folks on HN made when Dropbox launched, drawing comparisons to rsync and other Unix tools as if they were somehow equivalent.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.