Thread

1. bruhhhhhh · 1790166081 · focus · HN ↗

   I am hearing about Jev for the first time here so no idea about the hype. So their(Jev) is that the thing is faster at classification than a frontier model? Because the whole type safe aspect is already fully solvable with structured output. But their example is classification but that would also be possible and faster with a classic BERT model. So their pitch is a task specific smaller model or am I completely misunderstanding the whole thing?

   1. garciasn · 1790167767 · focus · HN ↗

      I am in no way trying to sell Jev here as some panacea of the modern world; I'm only responding to your questions:

      > But their example is classification but that would also be possible and faster with a classic BERT model.

      With BERT, you need a large, labeled dataset, and you have to train/fine-tune the model. Jev is pitched as a zero- or 'few-shot' model. You define the schema in code, give it instructions, and it works without a traditional training pipeline.

      > So their pitch is a task specific smaller model or am I completely misunderstanding the whole thing?

      Yup; that about sums it up: it is more or less an optimized, task-specific small model with the flexible understanding of a traditional LLM.

      1. prometheus1992 · 1790168788 · focus · HN ↗

         couldn't be more wrong - there are so many zero shot classifiers available on HF which do the same thing.

         1. garciasn · 1790169055 · focus · HN ↗

            I think you're possibly arguing a point I wasn't making? I'm not saying Jev invented zero-shot classification, or that there aren't already zero-shot classifiers on HF that can do classification without fine-tuning; I was responding to questions asked in a silo.

            1. cochne · 1790172477 · focus · HN ↗

               >With BERT, you need a large, labeled dataset, and you have to train/fine-tune the model.

               I think they were responding to this. You can use BERT to provide zero shot classification predictions.

               1. garciasn · 1790172693 · focus · HN ↗

                  I guess I assumed they meant BERT, not some specific BERT-base model. Vanilla BERT does not support zero shot.

Unofficial Hacker News client; not affiliated with Y Combinator.