Thread

1. brrrrrm · 1785815141 · focus · HN ↗

   this is cool but like, are we just vibe coding NAND burners at this point? these decode times don't really tell the whole story, because prefill becomes the bottleneck.

   half an hour to process 10k tokens on an M5 seems... not great

   1. kennywinker · 1785816466 · focus · HN ↗

      Not great for coding, or realtime agent interactions. But for background processing tasks overnight? Seems like it’d work pretty well

      1. selcuka · 1785824449 · focus · HN ↗

         I'm pretty sure one can rent a GPU for a few minutes with the electricity cost of leaving an M5 overnight.

         1. hdgvhicv · 1785827019 · focus · HN ↗

            Domestic electricity is free nowadays, certainly for most of the year, as solar plus battery covers your usage for a tiny percentage of the cost of your house.

            1. wccrawford · 1785837286 · focus · HN ↗

               Only if you don't count the cost of the equipment and installation.

               1. hdgvhicv · 1786040393 · focus · HN ↗

                  Or the cost of the house.

                  Given the cost of a building is far more than the cost of generating enough power for that building it doesn’t really matter

         2. kennywinker · 1785829162 · focus · HN ↗

            Sure. One could. But then one wouldn’t be in control of every step of the process.

Unofficial Hacker News client; not affiliated with Y Combinator.