‹ BackHN Continuity

Thread

Jeff – Jev-compatible 0.8B decision models, trained at home, ~30 ms

575 points · 225 comments · firelex

  1. vektormemory · · focus · HN ↗
    Can someone remove the extra LLM and just have an embedder do the classifier work?

    It's turning into pimp my llm...

    1. nojs · · focus · HN ↗
      Wait until you hear about support vector machines!
      1. baobabKoodaa · · focus · HN ↗
        If you have an easy problem that can be solved by a classifier from pre LLM era, then sure, go ahead. But we have LLMs now and we can use those to expensively and slowly classify harder problems using general purpose models, without needing to spend a huge amount of time fine tuning a model for the specific task. Jev offers to do the same fast and cheap.

        For clarity: no, a 0.8B model is not gonna do that.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.