‹ BackHN Continuity

Thread

Show HN: Maple-Preview – Ternary 20B MoE running at 120 tok/s on a iPhone

169 points · 52 comments · edwardbzhang

  1. zooloo99 · · focus · HN ↗
    Edge is edging closer!

    Super cool and a taste of what's to come with local AI becoming more accessible to low-end hardware.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.