Thread

1. PcChip · 1790889556 · focus · HN ↗

   I didn't see any benchmarks against vllm, sglang, exllama, etc

   1. rancor · 1790890078 · focus · HN ↗

      Since this is basically a wrapper around libllama.so, I would assume that the performance is roughly the same as llama.cpp upstream.

      1. nullpoint420 · 1790914499 · focus · HN ↗

         Woof. Wonder if the creator knows that

Unofficial Hacker News client; not affiliated with Y Combinator.