Thread

1. brrrrrm · 1785815141 · focus · HN ↗

   this is cool but like, are we just vibe coding NAND burners at this point? these decode times don't really tell the whole story, because prefill becomes the bottleneck.

   half an hour to process 10k tokens on an M5 seems... not great

   1. piyh · 1785857841 · focus · HN ↗

      SSD NAND reads are nearly infinite. Still makes me uncomfortable, but writing is what kills. There's a reason SSDs are rated by TBW, not TBR.

Unofficial Hacker News client; not affiliated with Y Combinator.