Thread

1. minimaxir · 1790702170 · focus · HN ↗

   > Cached input costs just $0.10 per million tokens—95% less than standard input pricing and 50% less than GPT‑6 Sol’s cached input pricing

   This is the actual big announcement. 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.

   1. joshstrange · 1790703602 · focus · HN ↗

      > 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.

      Cache doesn't help you much when you are compacting every 5 minutes...

      I was shocked at how quickly I ran out my $100/mo subscription with a single agent (sol medium).

      1. redox99 · 1790706261 · focus · HN ↗

         If you run out of sol medium with $100 you're doing something wrong. Astra destroys your usage, I get 1 day of usage with Astra, but 6 sol is almost unlimited and I only use xhigh.

         1. shimman · 1790709072 · focus · HN ↗

            "You're holding it wrong." Is hardly a retort from a real paying customer having problems with their paid services.

            This is why these companies are struggling to make money, they're chastising their customers just like they've been chastising the human race.

            1. Anonasty · 1790759784 · focus · HN ↗

               Literally the prompting and task definition is main variable how LLM's performs. There are literally millions of examples of vibe coders and new AI adopters who run out of tokens since they don't know how the LLM's work.

Unofficial Hacker News client; not affiliated with Y Combinator.