Thread

1. adrithmetiqa · 1790632786 · focus · HN ↗

   Forgive my lack of understanding but how long before Jev type functionality is just built straight into all frontier models?

   1. jubilanti · 1790643994 · focus · HN ↗

      Do people really have zero awareness that Structured Outputs with a constrained schema has been a thing for a while now, and open weight models that give you logprobs can give you distributions per key?

      Like what am I missing? I use Structured Outputs every day and this just seems like that with fewer steps?

      edit: Where I'm coming from, I can triage 10,000 support tickets with deepseek flash for less than $1, and latency is sub 1 second if it needs to be integrated into a live user flow. I don't need anything cheaper or faster than that.

      1. peab · 1790649528 · focus · HN ↗

         Yeah, I'm with you.

         Nowadays any LLM and any harness you use will just do this for you.

         But there are helper libraries like Instructor that have been around since like gpt3, which abstract away retries and stuff to make this super easy.

Unofficial Hacker News client; not affiliated with Y Combinator.