‹ BackHN Continuity

Thread

Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

310 points · 140 comments · leonickson

  1. jbird99 · · focus · HN ↗
    At what, 10 tokens per hour? These disk swapping methods all have the same drawbacks - kill your drive early, and slow as hell.
    1. throwawayffffas · · focus · HN ↗
      Am I the only one that has no flash lifetime anxiety? I still have drives from more than a decade ago that keep on chugging fine.

      I remember the time spinning rust was the only option and reliable they weren't. In 30 years of computing I have had more than ten hdds and zero ssds die.

      1. a96 · · focus · HN ↗
        No, flash is very durable. SSD's do die and they generally just go completely dead with no warning or any way to try any recovery. I've had a few go so far and I have a lot of old SSD's go in and out of machines.

        No normal use should wear out a drive in any sensible time in reasonable use and even in unreasonable use they seem to last almost indefinitely. There's more likely to be some other kind of component death before that.

        Of course, in staged lab test, it's probably possible to burn one out. I've seen projects do that on memory cards and various *ROM chips but don't recall seeing someone kill SSDs. That would get costly. But I'm almost sure a web search would turn out someone doing that.

        I also used to be sure that 90's SCSI HDDs would never really stop running. Just the machines using them became too much work and no utility to keep going. I remember only one of mine that wouldn't start after some years in the storage, but I managed to hammer it back into shape.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.