‹ BackHN Continuity

Thread

GPT-6 Sol and Luna

1779 points · 855 comments · OfficialTurkey

  1. jeffnash · · focus · HN ↗
    At this point, the deciding factors for me between Claude Code 20x and Codex Pro 20x are:

    1/ Usage limits: downstream of input/output cost, but resets and obscure windows and odd 20x plan / 5x plan != 4x usage math throw a wrench into it. Winner right now is Codex by a mile, especially when you factor in the fact that ChatGPT usage (even 6 Astra Pro) is essentially unmetered on the 20x plan. Always a bummer when asking if I should see a doctor about a rash means I can't code as much. It's also is a godsend if you use an MCP like oracle to automate the process of calling the Pro model on particularly tough problems, giving better planning results or deeper code analysis without burning usage.

    2/ Context window in the harness. Claude Code wins on this. There used to be a toml file workaround for Codex to extend the GPT context window to 1m, but this stopped working on the plans and only on per-token billing (ETA: noname120 pointed out this is no longer the case and it can be enabled again [1]). 252k is just not enough. Codex's compaction is very good, fwiw, but it happens so frequently that even a model as powerful as Astra sometimes loses the plot on long-running tasks.

    3/ Ability to use the plan outside of the official harness. Codex wins. Anthropic does shit like bills requests as extra usage if it sees a hermes.md in a commit.

    I've subscription hopped a bunch, and at times I've had both, but I keep coming back to Codex because it wins on 2/3.

    ETA: apparently I haven't been Keeping Up With the Altmans and new 20x signups have been disabled for a few weeks. I am grandfathered in, which makes the comparison above pretty much moot.

    [1]<a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49806060">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49806060

    1. glub · · focus · HN ↗
      &gt; Usage limits [...] Winner right now is Codex by a mile

      This hasn&#x27;t been the case since around July. If you measure usage in raw api costs, Anthropic is actually giving more on $200 than OpenAI now. This includes resets. Usage allocation difference would be humiliating for codex subs were it not for resets. But fixing usage limits with resets is ugly, and they&#x27;re not good for your mental well-being.

      &gt; Context window in the harness

      Codex now allows 1M for subs with config params. But generally speaking, you shouldn&#x27;t really be using 1M context. If you accidentally send a request with say, ~700k context already accumulated in a session which is outside cache TTL, you&#x27;re paying full cost of these 700k tokens.

      &gt; I&#x27;ve subscription hopped a bunch

      OpenAI actually has a new strategy to prevent subscription hopping after their 2-3 month-long marketing push to get claude-folks to switch over:

      you can&#x27;t buy a $200 sub anymore. So if you cancel, you won&#x27;t be able to get back in. Hostage situation, essentially.

      EDIT: re: usage limits, oh-my-pi maintainer has been tracking this - <a href="https:&#x2F;&#x2F;nitter.xitter.cc&#x2F;_can1357&#x2F;status&#x2F;2090075496948060372" rel="nofollow">https:&#x2F;&#x2F;nitter.xitter.cc&#x2F;_can1357&#x2F;status&#x2F;2090075496948060372

      1. platinumrad · · focus · HN ↗
        Given that Anthropic models are very verbose and OpenAI models can be very concise, wouldn&#x27;t a count of expected task completions be a better measurement than raw API costs?
        1. glub · · focus · HN ↗
          Perhaps. But Sol&#x2F;Astra also likes dumping pages of jargon-packed content at me, so I&#x27;m not sure it&#x27;s that much different. I actually still prefer the way Fable talks to me, even considering the horrible claudisms.

          But even if we leave that aside, OpenAI models are also much more eager than Anthropic, which are on the lazier side. Left unsupervised, Sol&#x2F;Astra will attempt to build a sha256 verified rocket ship if you ask them to fix a race condition in your to-do list app. Anthropic models will do what you asked for, maybe even forget to implement parts of that ask, but they won&#x27;t generally throw a slop granade at you.

          I can leave Fable orchestrator unsupervised for ~2h. Leaving Sol&#x2F;Astra unsupervised for ~2h means the next user turn will contain a message: &quot;what are you doing and why?&quot;.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.