‹ BackHN Continuity

Thread

Mercury 2.5 LLM hits 770 tokens per second

151 points · 92 comments · Retro_Dev

  1. the_arun · · focus · HN ↗
    Chat Jimmy clocks at 17K tokens per sec burning LLM into the Chip - <a href="https:&#x2F;&#x2F;chatjimmy.ai&#x2F;" rel="nofollow">https:&#x2F;&#x2F;chatjimmy.ai&#x2F; - Source: <a href="https:&#x2F;&#x2F;theashishmaurya.medium.com&#x2F;taalas-the-startup-that-prints-ai-models-directly-onto-silicon-33b181690575" rel="nofollow">https:&#x2F;&#x2F;theashishmaurya.medium.com&#x2F;taalas-the-startup-that-p...
    1. econ · · focus · HN ↗
      Would have made a nice local tool.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.