Thread

Sonnet 5.5

884 points · 613 comments · D2OQZG8l5BI1S06

thefourthchime · 1790622353 · focus · HN ↗
It does vey well at one shotting a PacMan clone, pretty much perfect. <a href="https://jonclegg.github.io/pacman-bakeoff/entries/claude-sonnet-5-5.html" rel="nofollow">https://jonclegg.github.io/pacman-bakeoff/entries/claude-son...
2nd only to Opus 5.5, which is perfect. <a href="https://jonclegg.github.io/pacman-bakeoff/entries/claude-opus-5-5-r2.html" rel="nofollow">https://jonclegg.github.io/pacman-bakeoff/entries/claude-opu...
Up until very recently, all models struggled with this.
All results: <a href="https://jonclegg.github.io/pacman-bakeoff/" rel="nofollow">https://jonclegg.github.io/pacman-bakeoff/
1. judge2020 · 1790623498 · focus · HN ↗
  Oh, it coded a Pac-Man clone. The clone was so good that I thought it was premade in some way and that Sonnet was going to play PacMan.
  1. thefourthchime · 1790623850 · focus · HN ↗
    Yes! The point being that up until yesterday, every model struggled with this, and now they don't.
    copperx · 1790627120 · focus · HN ↗
    "this" being recreating Pacman specifically, or games?
    londons_explore · 1790627676 · focus · HN ↗
    I made ~10 games with opus 5.5 (all multiplayer web games over web sockets).
    About half the time it made a playable game in a single short prompt. The other half of the time a few follow-up prompts were needed for refinement (eg. Things like "the blaster weapon is way too powerful, divide it's hit points by 10" or "we need a way to reconnect a player whose network dropped mid round" or "the GPS doesn't work on iOS")
    copperx · 1790627999 · focus · HN ↗
    Other models fail at oneshot creation of similar games?

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.