Thread

US Military had close call after using AI for hallucinated intelligence report

519 points · 396 comments · realsarm

jameson · 1789755937 · focus · HN ↗
It reminds me of the an Soviet officer who disobeyed early warning system's alert that US had launched four ICBMs and did not immediately relay the issue up to the chain of command.
<a href="https://en.wikipedia.org/wiki/Stanislav_Petrov" rel="nofollow">https://en.wikipedia.org/wiki/Stanislav_Petrov
<a href="https://en.wikipedia.org/wiki/1983_Soviet_nuclear_false_alarm_incident" rel="nofollow">https://en.wikipedia.org/wiki/1983_Soviet_nuclear_false_alar...
1. JumpCrisscross · 1789756247 · focus · HN ↗
  It reminds me of laughing at the stupid old Europeans starting a war because an Austrian numpty got himself shot in Serbia. Like, we almost sunk a Chinese ship because an AI thought the sour candies they were transporting were nukes is in the same category of shitheadedness. (I'm embellishing–we don't know what was on board.)
  1. pipes · 1789757567 · focus · HN ↗
    That's a very limited view of why ww1 started.
    JumpCrisscross · 1789758296 · focus · HN ↗
    > a very limited view of why ww1 started
    Proximate versus ultimate causes. If a war started because America boarded a Chinese vessel, it also-obviously–wouldn't solely be because of that.
    jordanb · 1789759323 · focus · HN ↗
    The basic problem is that they had built a domesday machine in Europe, which was the mobilization schedule.
    After the Franco Prussian war people realized that the next war would involve massive armies full of mobilized (conscripted) men and the country that could mobilize first would win. Countries spend decades planning for this by manufacturing enormous stockpiles of uniforms, giving their entire male population military training, etc.
    But the mobilization schedule for even the fastest country was still measured in weeks, but this was a process where days count. Basically once the decision was made to mobilize millions of people across an entire modern society would leap into action transforming itself into a marshal society. Millions of people getting called up, trains full of equipment going everywhere.
    Turning off a mobilization that was in progress was fairly difficult to conceive of, so once the decision was made the flywheel would take over, but decision to mobilize had to be made in a pressure cooker environment where hours mattered.
    The death of the duke wasn't the "cause" of WWI it was the starting gun for a race where the horses were all waiting impatiently at the starting line.
    JumpCrisscross · 1789761599 · focus · HN ↗
    Again, boarding a Chinese vessel similarly wouldn’t “cause” WWIII. But it would be a trigger and for non-pedantic usage of causation, proximate causes are also causes.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.