Thread

Vote on which of Hacker News' challenges for AI have been met

202 points · 271 comments · stabbles

hatthew · 1790903353 · focus · HN ↗
My comment about humanity's last exam being a misnomer is included, and I proposed better ideas about what a last exam could look like. One of the things I said was "solve an open math problem" which has conclusively been done with Navier-Stokes (regardless of the controversy surrounding that). However, in the spirit of clarifying the goalposts, AI has only passed 1/6 of the tests I proposed. 17% is not a passing grade, so I'd say no, my challenge has not been met.
Another thing to note is that the (presumably AI-generated) summary of my challenge does not accurately represent what I wrote, listing only half the things I said and saying "or" rather than "and".
1. intelkishan · 1790929511 · focus · HN ↗
  Could you share your other 5 tests, if they are public?
  1. hatthew · 1790931333 · focus · HN ↗
    Here's my previous comment: <a href="https://news.ycombinator.com/item?id=42809902">https://news.ycombinator.com/item?id=42809902
    I didn't really design a comprehensive test, just listed a few examples of the sort of thing I imagine when I head the name "humanity's last exam". So take it with a grain of salt.
    HanClinto · 1790950724 · focus · HN ↗
    "A human being should be able to change a diaper, plan an invasion, butcher a hog, conn a ship, design a building, write a sonnet, balance accounts, build a wall, set a bone, comfort the dying, take orders, give orders, cooperate, act alone, solve equations, analyze a new problem, pitch manure, program a computer, cook a tasty meal, fight efficiently, die gallantly. Specialization is for insects."
    -- Robert A. Heinlein
    _superposition_ · 1790958514 · focus · HN ↗
    This is literally my linked in bio.
    HanClinto · 1790965290 · focus · HN ↗
    It's not a complete list, but it really reminds me of the parent comment's criteria.
    If AI isn't achieving superhuman performance in all of these areas, I'm not sure we can actually call it "Humanity's Last Exam" -- it feels like a bit of an overextension.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.