‹ BackHN Continuity

Thread

Mercury 2.5 LLM hits 770 tokens per second

151 points · 92 comments · Retro_Dev

  1. bearjaws · · focus · HN ↗
    If you care about speed Cerebras gpt-oss-120b is 1400tk/s and "just as smart" in ranking.

    I've used it on a few for fun projects and its decent but the speed is crazy to watch.

    1. kylehotchkiss · · focus · HN ↗
      I felt happy I could run it at 100tk/s on my new Mac Studio :')
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.