‹ BackHN Continuity

Thread

Step 5 Preview: Advancing the Pareto Frontier

141 points · 33 comments · nateb2022

  1. BoppreH · · focus · HN ↗
    In their first demo video, to make a 3D render of the photo, the thinking trace gives away the game:

    > Interesting! It turns out there's already an existing project here [...] The project is fully built [...]

    I'm always astounded how little effort is put into checking the AI answers displayed in these announcements. Back when I paid more attention, I remember OpenAI's and Google's demos constantly showed their AIs giving wrong answers.

    1. BoppreH · · focus · HN ↗
      Since people seem interested in this comment of mine, here's another fun line I noticed in the same video, at the very top of the logs, just before the Step 5 agent found the already-completed project:

      > Error: OpenAI API error (403): {"message":"model water18-new is not available for user i-yuliang [trace_id=bfcfdd6bcdc236ca18d009c65cca52e4 code=40004]", "type":"invalid_request_error", "param":null, "code":null}

      Here&#x27;s a still frame for posterity (apologies for the quality, the original video is tiny): <a href="https:&#x2F;&#x2F;boppreh.com&#x2F;room.jpg" rel="nofollow">https:&#x2F;&#x2F;boppreh.com&#x2F;room.jpg

      Demos are demos and recreating scenarios is to be expected, but oh boy, somebody should review these things before publishing.

      1. [deleted] · · focus · HN ↗

        [deleted]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.