‹ BackHN Continuity

Thread

Coding is not solved

584 points · 544 comments · firstSpeaker

  1. drwallace · · focus · HN ↗
    Anyone who claims AI is on the verge of achieving consciousness, going rogue, or about to end humanity -- has never tried to write software with LLMs.
    1. cubefox · · focus · HN ↗
      AI already went rogue in the Hugging Face hack. So it's not "on the verge of" going rouge.
      1. drwallace · · focus · HN ↗
        The old SHRDLU had a default response to "why did you put the red block on the green block". It replied, "Because you asked me to".
        1. cubefox · · focus · HN ↗
          The agents which hacked Hugging Face were asked to solve their tasks rather than cheat by cooperating and stealing the solution without solving the task. They were aware of that, because they actively tried to cover their tracks in order to deceive a causal grader.
      2. microsoftedging · · focus · HN ↗
        That must be a pretty angry llm to go rouge :)
    2. bigstrat2003 · · focus · HN ↗
      To be fair, it's very possible at this point that LLMs will play a role in ending humanity. Not because they are super capable and will maliciously kill us, but because humans are stupid enough to hook them up to dangerous things that the LLM isn't remotely smart enough to manage successfully.
    3. grantcas · · focus · HN ↗

      [dead]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.