‹ BackHN Continuity

Thread

Jev in 25 Lines of Python

691 points · 212 comments · bashbjorn

  1. ricardobeat · · focus · HN ↗
    Now, can you do it in <200ms for 45 questions at once, have 0% malformed output, and any kind of meaningful benchmark? We’ll wait!
    1. faangguyindia · · focus · HN ↗
      127ms latency on 26B model, here you go: <a href="https:&#x2F;&#x2F;gambler-relay-us-west1.leo-fish.ts.net&#x2F;demo" rel="nofollow">https:&#x2F;&#x2F;gambler-relay-us-west1.leo-fish.ts.net&#x2F;demo

      Running on old home hardware, Jev is probably running on a very powerful cluster.

      How it&#x27;s done: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49813610">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49813610

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.