By now, there are usable quants by random people on HF, so it can be tested at home.
Reiterating what I said yesterday, I think what most people did miss here is that coding is probably not the main goal of this model.
It can also code, but the real target is the business processes that aren't code.
Think for example a support department, where new cases (in german!) should be automatically processed (or automatically draft processed) based on existing cases, without pumping all that data through a cloud api.
Or being a general sparring thing for non-IT workers.
__
If you want to code, you already operate in english, so there's the existing and better coding models for you.
But if you're some regular worker somewhere, you might just want to ask the thing to retrieve data on this specific project done three years ago and go through the shared email folder relating to it.
__
You can see that that might be the target, given that they've explicitly focused on getting the model to say "I don't know" instead of just making stuff up.
That is exactly the capability you need for these kinds of use-cases.
You can also see that in how it is optimized for speed and a fairly small KV footprint. The idea likely being that a business can pay like a few hundred euros once per worker and then have this kind of local capability for a team of 30.
hypfer · · focus · HN ↗
Reiterating what I said yesterday, I think what most people did miss here is that coding is probably not the main goal of this model. It can also code, but the real target is the business processes that aren't code.
Think for example a support department, where new cases (in german!) should be automatically processed (or automatically draft processed) based on existing cases, without pumping all that data through a cloud api.
Or being a general sparring thing for non-IT workers.
__
If you want to code, you already operate in english, so there's the existing and better coding models for you.
But if you're some regular worker somewhere, you might just want to ask the thing to retrieve data on this specific project done three years ago and go through the shared email folder relating to it.
__
You can see that that might be the target, given that they've explicitly focused on getting the model to say "I don't know" instead of just making stuff up. That is exactly the capability you need for these kinds of use-cases.
You can also see that in how it is optimized for speed and a fairly small KV footprint. The idea likely being that a business can pay like a few hundred euros once per worker and then have this kind of local capability for a team of 30.