It is obvious. I was going to build my own little toy doing just that ten days ago, and then found four pre-existing projects, so wrote those up instead: <a href="https://sgnt.ai/p/jev/" rel="nofollow">https://sgnt.ai/p/jev/
I think I'm gradually getting a picture of what jev does, and why it might be good:
1) one shot classifiers are great, and are well-known.
2) LLMs are also great classifiers, but are slow at output - and not great at guaranteed structured output.
3) everyone focused on LLMs, and forgot about classifiers.
4) any decent one shot classifier should be easy to run "fast"/"in realtime".
5) combining 4) with LLMs and a harness (a loop) open up some clever use-cases that LLMs alone are too slow for.
As I understand it, jev isn't long for this world (we'll have foss one shot classifiers we can run on modest hardware) - but it seems likely the legacy will be that classifiers will re-gain some prominence alongside generative models.
ttoinou · · focus · HN ↗
octoberfranklin · · focus · HN ↗
What isn't obvious is why people keep shouting "Jev Jev Jev" all the time.
Astroturf.
goodmythical · · focus · HN ↗
I cannot fathom how people are not seeing the multiple daily posts as anything but the spam they are.
OgAstorga · · focus · HN ↗
petesergeant · · focus · HN ↗
e12e · · focus · HN ↗
I think I'm gradually getting a picture of what jev does, and why it might be good:
1) one shot classifiers are great, and are well-known.
2) LLMs are also great classifiers, but are slow at output - and not great at guaranteed structured output.
3) everyone focused on LLMs, and forgot about classifiers.
4) any decent one shot classifier should be easy to run "fast"/"in realtime".
5) combining 4) with LLMs and a harness (a loop) open up some clever use-cases that LLMs alone are too slow for.
As I understand it, jev isn't long for this world (we'll have foss one shot classifiers we can run on modest hardware) - but it seems likely the legacy will be that classifiers will re-gain some prominence alongside generative models.
profstasiak · · focus · HN ↗