‹ BackHN Continuity

Thread

Analyzing Frontier Model Progress with My Favourite Game: Prince of Persia

63 points · 43 comments · msephton

  1. criemen · · focus · HN ↗
    A German magazine (c't) ran a Asteroids programming contest in 2008 - create a client with access to the emulator output of the game that provides keyboard inputs to control the game.

    The highest scoring submission that won the contest had a high score of around 137k. Last week, I had GPT-6 Astra, Sol and Luna implement and hill-climb on this task, as I wanted to see how big the difference in smartness is. Luna implemented something, but never exceeded ca. 20k points, with a large variance. Sol got something in the area of the humans implementation.

    Astra, which finished fastest, had a highscore of around 1.7Mm when the game seemed to fairly reliably crash. On the way, it disassembled parts of the ROM to extract information about the game.

    I didn't do a ton work to document and measure the specifics, but it was very impressive.

    1. NitpickLawyer · · focus · HN ↗
      > On the way, it disassembled parts of the ROM

      You should check the logs, there's probably a bunch of retro gaming forums that got hacked behind the scenes :D

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.