I think it would be totally incoherent to say that copyrighted information is essentially fair game to include in your model but the outputs of your model are privileged against being included in other models.
I'm not sure "competition" is necessarily the right word but I don't think that model creators and their political backers have a leg to stand on when complaining about distillation.
One is allegedly a copyright violation (fair use IMHO but still a grey area legally AIUI), one is a very explicitly a violation of the terms of service you agree to when signing up. And yes I do think that if somebody puts their website behind some barrier where a user has to actively affirm they won't download the contents and use it to train an LLM that should be protected by the same law for the same reason.
Are you arguing that training on copyrighted material is fine but distilling against tos is somehow bad? Lmao what a take. Nah, if copyright cant even be enforced then theres no way on earth violating a tos should ever have repercussions other than they ban you. stop carrying water theyre not gonna pay you
captainbland · · focus · HN ↗
I'm not sure "competition" is necessarily the right word but I don't think that model creators and their political backers have a leg to stand on when complaining about distillation.
DonsDiscountGas · · focus · HN ↗
hashmap · · focus · HN ↗