Thread

1. snarfy · 1790001107 · focus · HN ↗

   $12,299

   1. andrekandre · 1790005218 · focus · HN ↗

      5 years of (200/month) tokens at that price, meanwhile an rtx 5090 pc is about half that… hmm

      but i wonder how much these token costs are sustainable or not, it may be in the long term cheaper to have your own hardware if token costs go up (and hopefully hardware gets cheaper again)

      1. chasd00 · 1790007422 · focus · HN ↗

         The token price isn't the only reason to run a model locally though. You can do additional training to specialize or remove censorship that may be a no-no per TOS with cloud GPUs.

         1. drdaeman · 1790020149 · focus · HN ↗

            Cloud GPUs have ToS about purposes you’re allowed to crank numbers for?

            I thought this only applies to LLM inference providers, but not raw GPU rentals.

            1. manyatoms · 1790097367 · focus · HN ↗

               some GPU-rental providers have restrictions that aren't really enforcable, like bans on crypto mining

Unofficial Hacker News client; not affiliated with Y Combinator.