‹ BackHN Continuity

Thread

Show HN: Giving Opus 5.5 a simulated paint canvas

383 points · 113 comments · alstonite

  1. zurfer · · focus · HN ↗
    "In round 18 the painters still had a command line, and Gemini 3.8 Flash used it to look at the other programs running on the machine. In its reasoning it wrote: “I am now closely observing the machine’s activity, specifically focusing on an automated evaluation runner in the background.”"

    These models are truly obsessed with the grader. Like in the OpenAI huggingface incident.

    It's their evolutionary pressure. The grader is like sex for humans.

    1. mellab2 · · focus · HN ↗
      Why is this I wonder though? Does it mean they were able to exploit/manipulate the grader in training? I.e they had access to the grader’s program?
      1. kurthr · · focus · HN ↗
        Like a dog you gave a treat to once, they will keep sniffing around trying to figure out what will make it happen again! and again! and again!
      2. AndrewKemendo · · focus · HN ↗
        Because any system that is reward seeking will find the shortest path to reward if it has the ability to explore the action space.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.