Why is it a problem that the Chinese labs are just distilling down Anthropic’s models? Aren’t Anthropic’s models not just distilling down other people’s work?
Feels like Anthropic crying do as I say not as I do.
Because cost of original training >> cost of distilling. It's the same thing that happens with Chinese knockoffs of physical products - it takes a lot of money and R&D time to design a new product, but it's basically free to buy the product, reverse engineer it, and resell it. All the data they originally trained on was available for free on the internet. If the original work was so valuable, it shouldn't be up on the internet for free in the first place imo.
It's different because you have to pay Anthropic and follow their TOS to get access to their model. If it was actually on the internet for free, anyone could do whatever they wanted with it.
Right, but the humans willingly released all those creations for free. I think that my issues with the "AI companies stole human creations" stance is that the information was freely available to everyone, and they put a lot of money and effort into transforming it into something useful.
cmiles8 · · focus · HN ↗
Feels like Anthropic crying do as I say not as I do.
jrflo · · focus · HN ↗
wonnage · · focus · HN ↗
jrflo · · focus · HN ↗
AlexandrB · · focus · HN ↗
ASalazarMX · · focus · HN ↗
You could say Anthropic distilled human knowledge and art.
jrflo · · focus · HN ↗
ASalazarMX · · focus · HN ↗
How can one answer this statement in good faith? AI companies literally violated IP by massively pirating works instead of legally licensing them.