Why is it a problem that the Chinese labs are just distilling down Anthropic’s models? Aren’t Anthropic’s models not just distilling down other people’s work?
Feels like Anthropic crying do as I say not as I do.
What Anthropic is doing requires way more resources than what the Chinese labs are doing. So their complaint is that they do 95% of the work and the Chinese labs do the last 5% and call it their own.
An argument can be made that Anthropic is also only doing the last 5% of the work (because the content they are training on was the other 95%) but that's a bit more philosophical.
And the communal work of humanity is orders of magnitude more work than what anthropic pays for their scraping of content. I got no check from them for my contributions
Indeed, if it isn't a crime to train on humanity's data, it isn't a crime to train on capitalism arranged frontier LLM provider models. Is that bad for shareholders and capitalism? Meh, sounds like a suboptimal socioeconomic systems issue. Burn up all the capital the unsophisticated are willing to provide. “We are selling to willing buyers at the current fair market price.”
With my apologies to Brewster Kahle, "Universal Access to All Knowledge."
I have far less of a problem with the Chinese models if they even do this because they are making their models free, whereas the large Western LLM providers throw out a few bits but not their main work product. So not only are they hypocritical, I'm pretty sure that if the Chinese models were not released into the wild they would be making less noise.
Oh yeah, totally agree, I'd even rather pay those building the Chinese models if I didn't think I'd get thrown into a US gulag for felony contempt of business model.
cmiles8 · · focus · HN ↗
Feels like Anthropic crying do as I say not as I do.
jedberg · · focus · HN ↗
An argument can be made that Anthropic is also only doing the last 5% of the work (because the content they are training on was the other 95%) but that's a bit more philosophical.
bushbaba · · focus · HN ↗
toomuchtodo · · focus · HN ↗
With my apologies to Brewster Kahle, "Universal Access to All Knowledge."
<a href="https://www.youtube.com/watch?v=RV_ALlJGU_c" rel="nofollow">https://www.youtube.com/watch?v=RV_ALlJGU_c
jacquesm · · focus · HN ↗
toomuchtodo · · focus · HN ↗