Decision models like Jev don't beat LLM-as-a-judge or traditional classifiers
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
Decision models like Jev don't beat LLM-as-a-judge or traditional classifiers
Unofficial Hacker News client; not affiliated with Y Combinator.
Garlef · · focus · HN ↗
I think the abstraction is a useful one - a general purpose classifier that does not need to be specifically trained: Unstructured signal in, structured judgement out - with a focus on speed and cost efficiency.
And since there is not yet a large body of benchmarks, I don't think we have sufficiently explored how to measure these things.
But since there's a market and some hype this will soon happen.
(And it's not like TypesafeAI has a real moat or invented something entirely new here ~ they just managed to put things into one coherent perspecive)