Thread

Ollaya – Ollama for open-source, Jev-style decision models

618 points · 145 comments · Ardakilic

qurren · 1790370572 · focus · HN ↗
Would be great if you supported CUDA 12; I don't feel like paying $15K to upgrade my GPU right now
1. verdverm · 1790372206 · focus · HN ↗
  wait another week or so for vLLM's next release

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.