Thread

1. minimaxir · 1790702170 · focus · HN ↗

   > Cached input costs just $0.10 per million tokens—95% less than standard input pricing and 50% less than GPT‑6 Sol’s cached input pricing

   This is the actual big announcement. 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.

   1. joshstrange · 1790703602 · focus · HN ↗

      > 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.

      Cache doesn't help you much when you are compacting every 5 minutes...

      I was shocked at how quickly I ran out my $100/mo subscription with a single agent (sol medium).

      1. onlyrealcuzzo · 1790710720 · focus · HN ↗

         If you're compacting every 5 minutes, you have a workflow problem - period.

         No LLM will be cost effective if it's compacting this often. You have to find a way around it.

         1. ngruhn · 1790711655 · focus · HN ↗

            Context window is only 275k or something. And honestly compaction is not that bad in Codex. I often don't even notice I went through 5 compactions in a session.

            1. onlyrealcuzzo · 1790721660 · focus · HN ↗

               If it's compacting every 5 mins, you're going to notice it in your cache miss ratio and your costs...

               1. rrvsh · 1790728012 · focus · HN ↗

                  It doesn't - try it first

Unofficial Hacker News client; not affiliated with Y Combinator.