‹ BackHN Continuity

Thread

One Piece of Flock Camera Data Put This Innocent Woman in Jail for 13 Days

257 points · 145 comments · HotGarbage

  1. delichon · · focus · HN ↗
    > Regardless, the true takeaway of Isaacs’ experience is that ALPR technology, whether it’s from Flock or any of the other competitors in this space providing the same functionality (Axon, etc), is dangerous not only because it is so easily abused by police (or even by hackers) to invade the privacy and liberty of citizens, but also because it enables a lazy police department to outsource basic critical thinking to machines and then take action based on a single data point to ruin a person’s life.

    The accusation that some machine made any decision here goes beyond the reporting in the article. It seems concocted to raise AI alarm. All we have is that it supplied accurate data that police then abused. That isn't in the vicinity of "outsource[d] basic critical thinking to machines".

    I want such general government surveillance banned, but the machines in this story had no more volition than a breathalyzer.

    1. preg_match · · focus · HN ↗
      The machines matter, because we know how human behavior works. We know that if you give humans an automated tool that works most of the time, they get lazy, to the point where they make more mistakes than if they had no automation at all.
      1. nrmitchi · · focus · HN ↗
        Flock isn’t an automated tool though; you don’t give it a crime, and it gives back an automated package saying “this is who the criminal is”.

        As far as I know, it lets law enforcement query for things against the data. Can be specific (like a license plate) or more general (like a dark colored mid-sized SUV around <location> at <time>).

        To get where this story is at, cops here must have done the latter, and taken the first name off the top of the pile and patted themselves on the back, and then waited 7 months, and went and arrested her. Unless there’s an explanation for a 7 month delay, it seems designed to allow defensive evidence to spoil.

        There isn’t an uncanny-valley of automation here. There is just lazy, grossly-incompetent, bad-faith, and malicious cops/investigators.

        1. LocalH · · focus · HN ↗
          > Flock isn’t an automated tool though; you don’t give it a crime, and it gives back an automated package saying “this is who the criminal is”.

          Please tell the police that, then, under penalty of being blacklisted if they ever violate it. They're the ones treating it as such.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.