We’ve always had output schemas for LLMs, and we’ve had small language classifiers for decades, so what’s new? Is it just some sweet spot in between in terms of quality vs speed?
Anecdotal: LLMs like the hallucinate things and did a poor job of determining when to leave things null/blank. A more structured approach with confidence ratings helps resolve.
brap · · focus · HN ↗
We’ve always had output schemas for LLMs, and we’ve had small language classifiers for decades, so what’s new? Is it just some sweet spot in between in terms of quality vs speed?
kylehotchkiss · · focus · HN ↗