Thread

MiMo v2.6

1130 points · 483 comments · volf_

stymaar · 1790022964 · focus · HN ↗
Flash[1]: 309B total / 15B activated parameters
Pro [2]:, 1.02T total / 42B activated parameters
[1]: <a href="https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL" rel="nofollow">https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Flash-RL
[2]: <a href="https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL" rel="nofollow">https://huggingface.co/XiaomiMiMo/MiMo-V2.6-Pro-RL
1. verdverm · 1790023617 · focus · HN ↗
  curious why the HF pill (on the right) always has inaccurate values
  1. wren6991 · 1790055010 · focus · HN ↗
    Packed 4-bit weights are often identified as u8 byte arrays in the safetensors metadata, so the HF UI counts them as half a weight each.
    verdverm · 1790058463 · focus · HN ↗
    I would think there is sufficient information in the various config files to work this out, based what I've seen in my own quant artifacts.
    wren6991 · 1790062220 · focus · HN ↗
    Yeah, I agree it's probably fixable, but I think a naive interpretation of the metadata is probably the source of this bug (which HF has had for as long as I can remember)

Unofficial Hacker News client; not affiliated with Y Combinator.