‹ BackHN Continuity

Thread

Breaking the 1.58-bit Barrier for Ternary LLMs

245 points · 41 comments · matt_d

  1. plqbfbv · · focus · HN ↗
    Very interesting, I was just exploring this to hopefully fit one of the latest quantized models in 16GB of VRAM.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.