Thread

1. PowerElectronix · 1790861141 · focus · HN ↗

   It'd be a shame if their two main sources of income (openai and anthropic) were to go bust...

   1. layer8 · 1790868115 · focus · HN ↗

      In that unlikely case, open-weight hosting providers (and Google and Meta and SpaceXAI) would pick up the slack.

      The only chance of memory demand going down would be breakthroughs in model size reduction.

      1. formvoltron · 1790887313 · focus · HN ↗

         Also gpu speedup. If vera Rubin is 7x faster then to serve same number of tokens you need 1/7 the memory. Did I get that right?

Unofficial Hacker News client; not affiliated with Y Combinator.