‹ BackHN Continuity

Thread

Mercury 2.5 LLM hits 770 tokens per second

151 points · 92 comments · Retro_Dev

  1. walrus01 · · focus · HN ↗
    Pricing at $0.25 and $0.75 already puts its cost well above reasonably reputable inference providers for deepseek v4 flash or qwen 3.8-flash-next or similar class of open weight LLMs that fit in under 170GB of RAM, so I don't see the point. I think this is probably also stupider than laguna s 2.1 which can also be very cheap to serve.
    1. RussianCow · · focus · HN ↗
      The point is the speed.
      1. _aavaa_ · · focus · HN ↗
        If the model provides me with bad results because it's dumb, I don't care how quickly it does it.
        1. hermannj314 · · focus · HN ↗
          Is it possible to construct a control system where bad, fast and cheap can become good, fast, and cheap through repeated sampling and a strong spec/eval harness?

          I am trying to keep an open mind with AI, but I also have little understanding of control theory, trying to learn.

          1. freakynit · · focus · HN ↗
            Smaller models seems to get stuck in "loops" when you try to "handle" them this way.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.