With all the excitement around Jev, I suspect we'll see hundreds of options, it doesn't sound like Jev is that hard to replicate, given all the 3rd parties who are getting pretty damn close, or even better, results within a week.
vLLM has a PR very close to merging: <a href="https://github.com/vllm-project/vllm/pull/57250" rel="nofollow">https://github.com/vllm-project/vllm/pull/57250
Kev is an open Jev: <a href="https://github.com/jaredpalmer/kev" rel="nofollow">https://github.com/jaredpalmer/kev
verdverm · · focus · HN ↗
vLLM has a PR very close to merging: <a href="https://github.com/vllm-project/vllm/pull/57250" rel="nofollow">https://github.com/vllm-project/vllm/pull/57250
Kev is an open Jev: <a href="https://github.com/jaredpalmer/kev" rel="nofollow">https://github.com/jaredpalmer/kev