Aleph Alpha is just a sad joke by now. The talent isn't there anymore, they never managed to catch up to the other labs, failed to deliver on several projects, and by now are just a cash grab for the investors.
Only if you think in terms of short term gains, but thinking in the long run, doesn't really matter if these models are crap today, all models will eventually be obsolete, unless we plateau hard on every aspect of the tech.
What matters is to have good sovereign models in 5, 10, 20 years time.
I'm curious why you think sovereign models matter that much if open source ones exist (unless that stops at some point). Sovereign model hosting services, yes.
Just open weights are not enough, I think as a nation state you'd at least want a whole sovereign training pipeline. Otherwise you are stuck when Kimi K4 stops releasing their weights.
But I don't see why this needs to be done on a state-by-state level, a sovereign EU model seems to be much more realistic in terms of funding.
While an intriguing concept, that doesn't sound like it could scale to the amount of "cores" needed to do the work. Or am I missing something?
You want to, of course. There are several multi-billion dollar programs to subsidize fabs starting european offshoots. But so far not very successful, and it's not like one endeavour is blocking the other here.
9dev · · focus · HN ↗
gchamonlive · · focus · HN ↗
What matters is to have good sovereign models in 5, 10, 20 years time.
roncesvalles · · focus · HN ↗
HotHotLava · · focus · HN ↗
But I don't see why this needs to be done on a state-by-state level, a sovereign EU model seems to be much more realistic in terms of funding.
rixed · · focus · HN ↗
DoctorOetker · · focus · HN ↗
The annoying part of optical matrix multiplication is the conversion from electronic to optic and back.
Why not use electron-optics for matrix multiplication and use dynodes for amplification.
pstuart · · focus · HN ↗
HotHotLava · · focus · HN ↗