‹ BackHN Continuity

Thread

Mercury 2.5 LLM hits 770 tokens per second

151 points · 92 comments · Retro_Dev

  1. walrus01 · · focus · HN ↗
    Pricing at $0.25 and $0.75 already puts its cost well above reasonably reputable inference providers for deepseek v4 flash or qwen 3.8-flash-next or similar class of open weight LLMs that fit in under 170GB of RAM, so I don't see the point. I think this is probably also stupider than laguna s 2.1 which can also be very cheap to serve.
    1. RussianCow · · focus · HN ↗
      The point is the speed.
      1. _aavaa_ · · focus · HN ↗
        If the model provides me with bad results because it's dumb, I don't care how quickly it does it.
        1. RussianCow · · focus · HN ↗
          But there are lots of use cases where a relatively "dumb" model is good enough.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.