‹ BackHN Continuity

Thread

Jeff – Jev-compatible 0.8B decision models, trained at home, ~30 ms

575 points · 225 comments · firelex

  1. trebligdivad · · focus · HN ↗
    What proportion of commercial LLM use is classification? I'm just wondering what happens to business AI spending/data centre usage when they realise they don't need full LLMs.
    1. svachalek · · focus · HN ↗
      I'd expect the vast majority at this point is coding. Classification is a thing but in my experience tends to run on light, cheap models, not the proprietary frontier ones.
      1. RamblingCTO · · focus · HN ↗
        part of agentic engineering is classification as well tho. reviewing/gating, what to read etc. don't need a full LLM
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.