Thread

Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

104 points · 19 comments · Maverick617

dlcarrier · 1790894409 · focus · HN ↗
From what I've seen, Vulkan adds a lot of overhead on Intel hardware.
1. gunalx · 1790924172 · focus · HN ↗
  Yes and no. I tested llamacpp on my intel gpu with both vulkan and sycl. I measured them to be in the same ballpark even if i have se en pepole claim marger differences than i observed.
  In the end i took the sligth slowdown of vulkan to have a more stable and higher development velocity backend While being able to use identical setups on both intel and and gpus.

Unofficial Hacker News client; not affiliated with Y Combinator.