Thread

1. adrithmetiqa · 1790632786 · focus · HN ↗

   Forgive my lack of understanding but how long before Jev type functionality is just built straight into all frontier models?

   1. jubilanti · 1790643994 · focus · HN ↗

      Do people really have zero awareness that Structured Outputs with a constrained schema has been a thing for a while now, and open weight models that give you logprobs can give you distributions per key?

      Like what am I missing? I use Structured Outputs every day and this just seems like that with fewer steps?

      edit: Where I'm coming from, I can triage 10,000 support tickets with deepseek flash for less than $1, and latency is sub 1 second if it needs to be integrated into a live user flow. I don't need anything cheaper or faster than that.

      1. sampullman · 1790644139 · focus · HN ↗

         Price and speed are the difference. But deepseek flash is usually fast and cheap enough, so the use cases are somewhat limited.

Unofficial Hacker News client; not affiliated with Y Combinator.