‹ BackHN Continuity

Thread

Pirate Face Rescues LLM Models from Deletion

569 points · 149 comments · skepticalgenius

  1. phoyd · · focus · HN ↗
    Torrents should really be the preferred method for distributing AI model weights. Why rely on a single point of failure like Hugging Face? BitTorrent was made for exactly this.
    1. CodesInChaos · · focus · HN ↗
      In my experience public torrents often die as they grow older. It doesn't help that BitTorrent V1 makes long term seeding annoying, and BitTorrent V2 is almost never used.
      1. monsieurbanana · · focus · HN ↗
        I never understood this, is there anything that makes it difficult for the original uploader, the one that supposedly offers the file directly, to offer a torrent instead for the same amount of time?

        As far as perennity is concerned it seems strictly better.

        1. zenoprax · · focus · HN ↗
          Every change to the source is effectively a new torrent. This creates a ton of fragmentation as data is reorganized, remixed, reencoded, and so on.

          You can see this with many Linux distros: there is no single Debian torrent that people seed for years because there's always a refreshed version.

          Distros are a bad use case for P2P anyway since you depend on upstream as soon as you start upgrading and installing packages.

          1. NooneAtAll3 · · focus · HN ↗
            but model releases are already non-changeable?
            1. zenoprax · · focus · HN ↗
              Yes, models are a good use for P2P especially if everyone agrees to share the same torrent and someone (or a cohort) commit to seeding for the long haul.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.