‹ BackHN Continuity

Thread

Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

104 points · 19 comments · Maverick617

  1. antonyragleap · · focus · HN ↗
    Curious about Vulkan overhead on Intel vs AMD/Nvidia for long context. Any benchmarks vs vllm/sglang?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.