Thread

1. reedf1 · 1790785294 · focus · HN ↗

   I've been running Qwen 3.8 27b (an opus 4.6 tier model), locally on a 5090 for just over two weeks @ 170 tokens/s. That's a frontier model from 9 months ago running on consumer hardware. Who knows where distillation and pruning gets us in another year.

   1. bix6 · 1790785813 · focus · HN ↗

      $9k for a 5090 now? Sheesh.

      1. off_with_their_ · 1790785910 · focus · HN ↗

         $9k is a small price to pay to experience the rapturous glory of AGI. I'd easily pay up to 3 times that to comfortably run the superintelligent models released in this post RSI world.

         1. literalAardvark · 1790786744 · focus · HN ↗

            Except you can do that cheaper by renting compute

Unofficial Hacker News client; not affiliated with Y Combinator.