‹ BackHN Continuity

Thread

Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

104 points · 19 comments · Maverick617

  1. kgeist · · focus · HN ↗
    This seems to be a thin wrapper around libllama, what's the point? Llama.cpp already ships a web server. I don't see anything in the README that llama.cpp doesn't already support.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.