Thread

1. adrithmetiqa · 1790632786 · focus · HN ↗

   Forgive my lack of understanding but how long before Jev type functionality is just built straight into all frontier models?

   1. Ohentis · 1790635988 · focus · HN ↗

      I don't think there would be any utility for that. Anything jev can do, a frontier model can also do. Just not as quickly or as cheaply.

      1. tbeseda · 1790636782 · focus · HN ↗

         I think these products (Jev and the inevitable offerings from Anthropic, OpenAI, etc) want to become more than end-user output machines. They'd benefit from being in the hotpath of other services. Not backgrounded generation but in-band, request-time work.

         1M x $0.50 == 1B x $0.0005

         1. transitorykris · 1790637769 · focus · HN ↗

            To expand a bit for my current use cases. Inline routing of work to heavy task specific models, and prompt/context generation (user is asking something, what and how much should we prompt the expensive LLM with). Latency or time to first token does matter for some applications.
         2. Ohentis · 1790726125 · focus · HN ↗

            [dead]

Unofficial Hacker News client; not affiliated with Y Combinator.