It is hard to see how the environmental side effects of this aren't going to be somewhere between bad and disastrous.
If we're all using distilled open-weight models in ASICs in our own systems the energy cost will come way down. The question is when that becomes a reasonable solution for a broad set of use cases.
hermitcrab · · focus · HN ↗
cestith · · focus · HN ↗