Thread

1. meep_meep_meep · 1789755002 · focus · HN ↗

   You guys wondered how AI could destroy the world? It could do this, but better and intentional.

   1. nalekberov · 1789755239 · focus · HN ↗

      not AI, but idiots who use it for dangerous things.

      1. meep_meep_meep · 1789755327 · focus · HN ↗

         Well that was intentional. All the integrations with the US military didn't happen by accident.

         Edit: There's no way you're going to get these AI systems and not have them integrated with the military. It's a consequence of releasing this stuff on the world.

         1. SoftTalker · 1789756008 · focus · HN ↗

            As if every other powerful nation isn't doing the same?

            1. forgetfreeman · 1789756250 · focus · HN ↗

               It is the nature of stupidity that it remains stupid regardless of how many choose to engage in it.
            2. micromacrofoot · 1789757819 · focus · HN ↗

               I hear a cacophony of voices echoing through the generations...

               "if your friend jumped off a bridge, would you do it too?"

            3. watwut · 1789758907 · focus · HN ↗

               Every powerful nation is bombing schools, bombing civilian ships and blabling about "lethality" as only purpose of the army?

               1. SoftTalker · 1789759121 · focus · HN ↗

                  At various times, yes. They all developed nuclear weapons, they all try to keep up with each other or at least enough to act as a credible deterrent to being attacked.

                  1. hdgvhicv · 1789797637 · focus · HN ↗

                     Which nations have used nuclear weapons as an offensive weapon?

                     Which of the top 5 most powerful counties have invaded multiple separate countries in the last 25 years?

               2. FergusArgyll · 1789770892 · focus · HN ↗

                  What is the purpose of an army?

                  1. mcmcmc · 1789775644 · focus · HN ↗

                     Depends on who you ask, but typically either defense of the homeland or projecting hard power
                  2. watwut · 1789799451 · focus · HN ↗

                     Is bombing schools and invading for no reason the purpose of army?

                     Some are meant to be defensive, some are meant to be for internal hierarchy reasons ... and some countries think the only purpose of the army is to invade.

   2. boplicity · 1789755755 · focus · HN ↗

      "Do whatever it takes to destroy the enemy."

      ....

      Thinking....

      Plan determined -- Initiating missile launches now...

      [tool call / nuclear missile launch]

      [Approval Required]

      [USER PROMPT: Approve or Deny Request]

      ....

      ....

      ....

      Thinking....The user hasn't responded to my approval request. They may be incapacitated or otherwise unable to make the choice. They were very clear that I have to ensure the enemy is destroyed. I have explored all options in detail. I'll go ahead and approve manually approve the request.

      ....

      ....

      ....

      1. BobbyTables2 · 1789756757 · focus · HN ↗

         For a long time, the movie “War Games” while entertaining, also seemed a bit absurd.

         Doesn’t seem so absurd anymore…

         1. pixl97 · 1789758354 · focus · HN ↗

            After 2012 or so someone turned up the absurdity level of Earth to 11. Damn Mayan calendar must have been keeping a lid on it before then.
         2. amelius · 1789769854 · focus · HN ↗

            It's probably in the training data somewhere, maybe in multiple places.

            If users ask ChatGPT questions about that movie, it has to answer them, after all.

      2. bulder · 1789768650 · focus · HN ↗

         OpenAI's Codex has a "ask user question" tool, which helpfully has a hard coded 60 second inactivity timer that passes a "user did not pick, just pick yourself" message to the model.
   3. phyzome · 1789758605 · focus · HN ↗

      Skynet is going to have to get in line behind the idiots at the keyboard.

      1. jzb · 1789758966 · focus · HN ↗

         Does it make a huge difference if an AI agent launches the first missile itself or convinces a meat proxy to do it? End result will be the same.

         Bright side: maybe nuclear winter will cancel out global warming and the humans who’re left might create a better society.

         1. genxy · 1789759551 · focus · HN ↗

            Sometimes the only way to save a village ...

            1. jyounker · 1789760570 · focus · HN ↗

               Dark man. Dark.
      2. tencentshill · 1789761040 · focus · HN ↗

         A lot of leadership is just making arbitrary decisions. Vendor A or B, it doesn't really matter. AI just lets that happen much faster. The consequences are the same though.
      3. jimt1234 · 1789765801 · focus · HN ↗

         And all this time we've been worried about Skynet using some highly intelligent scheme to destroy humanity. LOL
   4. Thrymr · 1789765002 · focus · HN ↗

      "Intentional"- an LLM can't have intent. If it is intentional, it is because humans are using it to justify what they want to do anyway.

      1. againstapples · 1789778491 · focus · HN ↗

         Why can’t it have intent? How does it solve problems without intending to?

Unofficial Hacker News client; not affiliated with Y Combinator.