Thread

1. sharih · 1790687184 · focus · HN ↗

   What is the point of this, if it is p90 17 seconds? Might as well use an LLM. The beauty of Jev is that it is dirt cheap and insanely fast.

   1. zihotki · 1790687732 · focus · HN ↗

      I would hold your horses to paint it as dirt cheap.. In my cases for spam detection Luna was 20% cheaper due to prompt caching, although not as fast.

      1. simplisticelk · 1790706028 · focus · HN ↗

         Is that just because the Jev implementation is less mature? Couldn't it also implement prompt caching?

Unofficial Hacker News client; not affiliated with Y Combinator.