‹ BackHN Continuity

Thread

Mercury 2.5 LLM hits 770 tokens per second

151 points · 92 comments · Retro_Dev

  1. bearjaws · · focus · HN ↗
    If you care about speed Cerebras gpt-oss-120b is 1400tk/s and "just as smart" in ranking.

    I've used it on a few for fun projects and its decent but the speed is crazy to watch.

    1. verdverm · · focus · HN ↗
      if you want to feel the speed without the burn

      <a href="https:&#x2F;&#x2F;kamilstanuch.github.io&#x2F;LLM-token-generation-simulator&#x2F;" rel="nofollow">https:&#x2F;&#x2F;kamilstanuch.github.io&#x2F;LLM-token-generation-simulato...

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.