Thread

1. IshKebab · 1790702029 · focus · HN ↗

   I wish they'd list the environmental cost. My employer has an unlimited AI budget so I don't care about using Astra if it's just more profit for OpenAI. I care more if it actually uses 5x more energy.

   1. otterley · 1790702501 · focus · HN ↗

      Given that the number one cost of inference is memory and compute, and the incremental cost of each is energy, cost per inference is roughly proportional to energy consumption.

Unofficial Hacker News client; not affiliated with Y Combinator.