I know we have strong views on what a truly open model is (open weights, open training data, open training code etc.) but I really like how transparent they’ve been about the training of this model.
The realtime dashboard they shared during training (<a href="https://mimo.xiaomi.com/rl/" rel="nofollow">https://mimo.xiaomi.com/rl/) was an incredible learning and teaching tool for me, and they’ve been unusually comprehensive in sharing details about their methodology (check out that tech report - it's got lots of clever behind the scene tricks like Google or Deepseek writeups) and benchmark scores (even the stuff they didn’t do well on).
If you’re releasing an open model going forward, please consider offering the community more of this transparency!
I was absolutely mind blown when I saw how they were publishing that training dashboard while US models publish 100s of pages of reports (just provide a "copy as MD" button, folks, in the future). I was thinking about doing something similar but did not know how to show it, and this is a perfect example for someone who wants to show whatever they are training, for me it was local training on a consumer GPU.
My dream is to see this like a dashboard for a model trained across distributed machines, like Bitcoin mining, where minted coins are given to people whose machines were used for training. I don't know if they are worth it, but bragging rights alone, like a tag they can put on a website or social media, will be good enough for me.
Thank for starting a thinking thread. The way I thought about this was everything is preset, model, data (prepared, cleaned) and we cannot prevent duplicate training but find a way to get the most recent weights is of now and share it when possible to synchronize; most recent weights always available on torrent. Now addressing your questions
A) how do I trust the weights passes along is when we can use the crypto proof of stake for which we need some kind of coin I suppose.
B) dataset is prepared so, it’s open. I don’t know if that helps or not
C) What has this to do with content creators ? You mean when content creators use the model, they get coins ? I have not thought about that angle.
rao-v · · focus · HN ↗
The realtime dashboard they shared during training (<a href="https://mimo.xiaomi.com/rl/" rel="nofollow">https://mimo.xiaomi.com/rl/) was an incredible learning and teaching tool for me, and they’ve been unusually comprehensive in sharing details about their methodology (check out that tech report - it's got lots of clever behind the scene tricks like Google or Deepseek writeups) and benchmark scores (even the stuff they didn’t do well on).
If you’re releasing an open model going forward, please consider offering the community more of this transparency!
bicepjai · · focus · HN ↗
My dream is to see this like a dashboard for a model trained across distributed machines, like Bitcoin mining, where minted coins are given to people whose machines were used for training. I don't know if they are worth it, but bragging rights alone, like a tag they can put on a website or social media, will be good enough for me.
BodyCulture · · focus · HN ↗
A) How to prevent malicious injection of bad training data?
B) How to handle copyright violations, will participants be responsible and will they have to pay the creators?
C) Can this create an income stream for content creators and how to avoid abuse, eg feeding with AI content?
So many more, but let’s focus on these before we break things fast because we didn’t think about them.
bicepjai · · focus · HN ↗
This can be a fun conversation and discussion.