‹ BackHN Continuity

Thread

Jev in 25 Lines of Python

691 points · 212 comments · bashbjorn

  1. bruhhhhhh · · focus · HN ↗
    I am hearing about Jev for the first time here so no idea about the hype. So their(Jev) is that the thing is faster at classification than a frontier model? Because the whole type safe aspect is already fully solvable with structured output. But their example is classification but that would also be possible and faster with a classic BERT model. So their pitch is a task specific smaller model or am I completely misunderstanding the whole thing?
    1. Foobar8568 · · focus · HN ↗
      One thing I would like to know is how fast it is when it's being presented with a 8000 ctx prompt? 16k? 32k?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.