Thread

1. vulture916 · 1790884845 · focus · HN ↗

   Jev = $0.042/m input, output free Clef = $0.24/m input, no output price listed

   At 300 tokens per call, you'd get:

   One million decisions on Jev cost about $12.60. One million decisions on Clef cost about $72.

   Would probably make sense to self-host Clef, if you have the capability/resources. If not...

   1. strangescript · 1790896546 · focus · HN ↗

      Because Clef is a larger model, larger context, can process images. Plus its open weights, so you can run it yourself.

      Since it benches better than Jev, Jev is probably smaller and easier to host. They could also be losing a lot of money.

      1. wongarsu · 1790932242 · focus · HN ↗

         Considering Jev is named after Jevon's Paradox (making things cheaper increases spending) I'm willing to bet that it's the former. Smaller model, possibly an inference pipeline optimized for a Jev-like workload (large shared context that is used for multiple questions in parallel)

         And while Jev has a lot of latency, that latency stays very flat with larger inputs. So it's probably related to their inference pipeline, not model size

         1. andrewingram · 1790942102 · focus · HN ↗

            It's anecdata, but I ported a Jev-based prototype i've been working on to Clef, and it ended up being significantly slower and the results were worse.

Unofficial Hacker News client; not affiliated with Y Combinator.