Thread

1. minimaxir · 1790702170 · focus · HN ↗

   > Cached input costs just $0.10 per million tokens—95% less than standard input pricing and 50% less than GPT‑6 Sol’s cached input pricing

   This is the actual big announcement. 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.

   1. joshstrange · 1790703602 · focus · HN ↗

      > 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.

      Cache doesn't help you much when you are compacting every 5 minutes...

      I was shocked at how quickly I ran out my $100/mo subscription with a single agent (sol medium).

      1. onlyrealcuzzo · 1790710720 · focus · HN ↗

         If you're compacting every 5 minutes, you have a workflow problem - period.

         No LLM will be cost effective if it's compacting this often. You have to find a way around it.

         1. ngruhn · 1790711655 · focus · HN ↗

            Context window is only 275k or something. And honestly compaction is not that bad in Codex. I often don't even notice I went through 5 compactions in a session.

            1. Benjamin_Dobell · 1790728918 · focus · HN ↗

               The context window is configurable. I've been using ~600k for months. No, not API pricing, on a Codex sub.

               ~/.codex/config.toml

                 model = "gpt-6.1-sol"
                 model_context_window = 700000
                 model_auto_compact_token_limit = 630000

Unofficial Hacker News client; not affiliated with Y Combinator.