‹ BackHN Continuity

Thread

Shapelearn Qwen 3.8 27B (13.1 GB VRAM)

104 points · 39 comments · syntaxing

  1. sheo · · focus · HN ↗
    Aged like milk

    <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49746618">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49746618

    1. txrx0000 · · focus · HN ↗
      Not really. The largest IQ4_XS quant here is still worth it because Bonsai doesn&#x27;t offer larger quants. They could beat it if they made a quaternary variant though, I don&#x27;t know why they&#x27;re stopping at ternary.
      1. [deleted] · · focus · HN ↗

        [deleted]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.