‹ BackHN Continuity

Thread

Mercury 2.5 LLM hits 770 tokens per second

151 points · 92 comments · Retro_Dev

  1. nylonstrung · · focus · HN ↗
    I honestly think the diffusion LLM approach is a dead end

    It's telling that frontier labs like Google toyed around with it but didn't invest further even for their most speed and cost sensitive small models

    Still unclear for what, if any use cases this is pareto frontier

    1. kennywinker · · focus · HN ↗
      DiffusionGemma was released alongside the other gemma-4 models just a few months ago, so clearly google hasn't abandoned the idea.

      K2-Horizon-7B has a diffusion and non-diffusion variant, and they claim the same level of intelligence from both models.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.