‹ BackHN Continuity

Thread

US Military had close call after using AI for hallucinated intelligence report

519 points · 396 comments · realsarm

  1. vegnus · · focus · HN ↗
    I hope I am alive for the history books of tomorrow.

    "The Department of War (as it became known as), forewent it's traditional intelligence structure (the most expensive ever seen till that point), in order to have a private companies computer software generate viable targets for an upcoming operation. Believing that the software had real time updates on the current status and intelligence of the operation, as if it were some kind of oracle, the operation went as planned. Six schools, mistakenly identified as hostile targets (due to the heavy American bias in the softwares training data), were drone striked, resulting in the deaths of hundreds of innocents. Still, the people did nothing."

    1. etc-hosts · · focus · HN ↗
      The girls school strike was followed up by a strike minutes later. Same spot. The girls school children was probably made up of the kids of IRGC members.

      A strike on the girls school would attract IRGC members to it, who could be finished off with the second strike.

      I think the attack was deliberate.

      1. cyanydeez · · focus · HN ↗
        you are way to forgivining in how stupid the military is under current leadership.

        This sounds like the same type of Israel apologism. "OK, well we kill a bunch of innocents, but they were related to all those evil people"

        1. unethical_ban · · focus · HN ↗
          I don't think "They deliberately murdered 100 children to lure opposition military officers in for a second strike" is apologism.
        2. derwiki · · focus · HN ↗
          I didn’t read it as apologism, just a theory that it may have been done intentionally
        3. 2OEH8eoCRo0 · · focus · HN ↗
          People don't like thinking that a lot of good people can die from a mistake.
        4. lopsotronic · · focus · HN ↗
          Israeli "Lavender" AI-assisted targeting was used with/in "Where's Daddy"[1] mode, which had several frameworks for using family to strike identified targets. One method is to liquidate the residence with maximum family members on prem, which had a high chance of drawing the target to the location where a second strike would have a high chance of lethality.

          One aspect of Lavender that proved frustrating: the system identified so many targets that exasperated ground controllers eventually just ordered the equivalent of full on carpet bombing. When the whole building's showing up as red on your computer screen, I suppose that makes sense. From a particular perspective.

          [1] I'm . . uh . . not making that up. That what is/was called. Undoubtedly it has a more digestible name now.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.