‹ BackHN Continuity

Thread

Show HN: Maple-Preview – Ternary 20B MoE running at 120 tok/s on a iPhone

169 points · 52 comments · edwardbzhang

  1. Havoc · · focus · HN ↗
    Looks promising though much like the bonsai tenary one it hallucinates knowledge quite aggressively. The online chat having search tools covers this up somewhat, but it's still there.

    ...from very unscientific casual vibes it does seem pretty good though considering the speed

    Would also be curious what their search tool backend looks like - that too is very fast for very rapid multiple searches

    1. zooloo99 · · focus · HN ↗
      Makes me wonder how much we can 'get away with' in terms of raw model capability, when you have tool access for anything specialised or specific.

      I probably could make up a bit of an incorrect carrot cake recipe if asked on the spot, but with a Google search I can give you something far more robust.

      Maybe we don't need a 'country of geniuses' in our pocket, but more a helpful assistant that can reasonably reason!

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.