Why do you think the Chinese labs figured this out before the western labs? No reason to believe that whatsoever.
Why wouldn't you? It's the most plausible interpretation given what we know.Had western labs figured that out before, they would have used it to make kv caching cheaper before and not only now.The burden of proof here is on western labs. But I doubt they'll try to lie that much.
I dunno, they've been competitive in the lies market lately. It's just a matter of ambition.
why_only_15 · · focus · HN ↗
bel8 · · focus · HN ↗
Had western labs figured that out before, they would have used it to make kv caching cheaper before and not only now.
The burden of proof here is on western labs. But I doubt they'll try to lie that much.
tescreal · · focus · HN ↗