‹ BackHN Continuity

Thread

Vote on which of Hacker News' challenges for AI have been met

202 points · 271 comments · stabbles

  1. hatthew · · focus · HN ↗
    My comment about humanity's last exam being a misnomer is included, and I proposed better ideas about what a last exam could look like. One of the things I said was "solve an open math problem" which has conclusively been done with Navier-Stokes (regardless of the controversy surrounding that). However, in the spirit of clarifying the goalposts, AI has only passed 1/6 of the tests I proposed. 17% is not a passing grade, so I'd say no, my challenge has not been met.

    Another thing to note is that the (presumably AI-generated) summary of my challenge does not accurately represent what I wrote, listing only half the things I said and saying "or" rather than "and".

    1. an0malous · · focus · HN ↗
      How can you say it’s conclusively been done if it might have been stolen from a math researcher and was aided in unknown ways by a whole team of math researchers? I find it mind boggling that HN just accepts these shenanigans with no transparency. At the very least, they could share the conversation / thinking trace easily and if their claims are true there shouldn’t be anything controversial or negative for their company in the trace.
      1. senordevnyc · · focus · HN ↗
        Yeah, they could easily just share the untold trillions of tokens the 10k agents generated over 88 hours, which would also be a goldmine for their competitors, no big deal.

        I find it mind boggling that anyone thinks these agents only solved this problem because they maybe could possibly have seen the unfinished work of researchers who were working on a simpler version of the problem, (also with AI).

        Looking forward to the cope when the next big problem falls.

        1. _superposition_ · · focus · HN ↗
          Yeah they don't want to share the tokens because I guarantee it's a bunch of nonsense trial and error leaning on lean for verification. Those tokens will show the lack of intelligence, not the presence of it.
          1. someonebaggy · · focus · HN ↗
            A machine that solves open problems by brute force trial and error is still pretty cool.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.