Thread

GPT 6.1 Sol: Near-Astra intelligence for a fifth of the price

1066 points · 953 comments · crorella

minimaxir · 1790702170 · focus · HN ↗
> Cached input costs just $0.10 per million tokens—95% less than standard input pricing and 50% less than GPT‑6 Sol’s cached input pricing
This is the actual big announcement. 50% cheaper cache than GPT-6 Sol will get you far more mileage on Codex.
1. TuxSH · 1790702497 · focus · HN ↗
  Exactly half as expensive as Opus 5.5 in every API pricing metric
  1. dom96 · 1790704720 · focus · HN ↗
    Based on my benchmark[1] it is the same price as Opus 5.5 and just as capable.
    1 - <a href="https://bench.killswitch-lang.org" rel="nofollow">https://bench.killswitch-lang.org
    zeroonetwothree · 1790709807 · focus · HN ↗
    Opus 5 scoring higher than 5.5 makes me question of the value of this benchmark to real world usage
    dom96 · 1790710300 · focus · HN ↗
    Well, it is genuine.
    Opus 5.5 fails the "understanding" tasks which Opus 5 passes. I feed it a script which takes two numbers and prints the max of the two numbers. Opus 5.5 thinks it prints 1/0 instead of the max numbers. Opus 5 gets it right.
    Here are the outputs from both: <a href="https://gist.github.com/dom96/b5bce82b6e6c1ebd5271ed70ad941b49" rel="nofollow">https://gist.github.com/dom96/b5bce82b6e6c1ebd5271ed70ad941b....
    Looking at that Opus 5.5 fails to deduce that the "hack statement" is actually an if statement in disguise, but Opus 5 gets this right. I feel like this is a pretty good test and shows Opus 5's greater intelligence for what it's worth.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.