I'm also grateful to the Chinese labs for providing workarounds for the walled gardens that the US based AI companies are attempting to create.
Does anyone know if there are any distillation datasets available? I'd love to see these distributed on BitTorrent. I think it's critical that AI be democratized and not isolated in the hands of a few private companies.
I agree it would be very cool if they were open sourced, but the article is talking about the KV cache technique which if I understand correctly is open source (or at least the white paper is published).
slowin · · focus · HN ↗
Does anyone know if there are any distillation datasets available? I'd love to see these distributed on BitTorrent. I think it's critical that AI be democratized and not isolated in the hands of a few private companies.
10xDev · · focus · HN ↗
slowin · · focus · HN ↗
abirch · · focus · HN ↗
slowin · · focus · HN ↗