I know we have strong views on what a truly open model is (open weights, open training data, open training code etc.) but I really like how transparent they’ve been about the training of this model.
The realtime dashboard they shared during training (<a href="https://mimo.xiaomi.com/rl/" rel="nofollow">https://mimo.xiaomi.com/rl/) was an incredible learning and teaching tool for me, and they’ve been unusually comprehensive in sharing details about their methodology (check out that tech report - it's got lots of clever behind the scene tricks like Google or Deepseek writeups) and benchmark scores (even the stuff they didn’t do well on).
If you’re releasing an open model going forward, please consider offering the community more of this transparency!
I don't work with large language models, but out of curiosity: mimo's score on DeepSWE keeps going up, so why are they stopping training early? Is it due to budget constraints?
It looks like the curve is flattering, and the current state actually looks slightly cherry picked (it matches a previous spike that looks a bit of an outlier before the result went down). The longer they train, the more they risk getting scooped by another release by someone else. Etc etc it's a judgement call based on all of these factors (and more, including cost/occupying a big cluster as you mention)
+1 at some point, you need to expect to train a much better base model using everything you've learnt. At the least, you probably want to bring on line the next 10 clever RL environments and ideas your team has been cooking up (which will pipeline into v2.7 etc.)
rao-v · · focus · HN ↗
The realtime dashboard they shared during training (<a href="https://mimo.xiaomi.com/rl/" rel="nofollow">https://mimo.xiaomi.com/rl/) was an incredible learning and teaching tool for me, and they’ve been unusually comprehensive in sharing details about their methodology (check out that tech report - it's got lots of clever behind the scene tricks like Google or Deepseek writeups) and benchmark scores (even the stuff they didn’t do well on).
If you’re releasing an open model going forward, please consider offering the community more of this transparency!
chenzhekl · · focus · HN ↗
creato · · focus · HN ↗
rao-v · · focus · HN ↗