‹ BackHN Continuity

Thread

A Privacy Analysis of Web and Mobile Conversational AI Agents [pdf]

425 points · 141 comments · damaru2

  1. drywater2 · · focus · HN ↗
    No, they don't "leak data", data is sold. Leaking data requires a mistake. This is intentional.
    1. dgellow · · focus · HN ↗
      I’m not sure. It could definitely be incompetence. We are talking about an industry rushing as fast as possible in every directions, their systems are very likely a complete mess. I really wouldn’t be surprised if advertisers are getting that data for free just because the AI labs didn’t bother
      1. coliveira · · focus · HN ↗
        It's because of people like you that these companies have a free ride. When we're talking about billion dollar companies there's no such thing as a "mistake", because they need to be held accountable for everything that they do. Thinking otherwise let them keep the rewards while getting away with anything wrong they cause to society.
        1. wtetzner · · focus · HN ↗
          Just because something is due to incompetence instead of malice doesn't mean they shouldn't be held accountable.
          1. yoyohello13 · · focus · HN ↗
            Blaming incompetence instead of malice is always used as a backlash diffusion mechanism. We should stop attributing incompetence to obvious malice.
            1. paimapi · · focus · HN ↗
              there's always some organizational, systematized intent in the creation of incompetence. all organizations should be accountable for it's workers and their adherence to policy - it's why safety regulations and training exist, after all

              if you have an individual who has been sexually harassing others regularly the problem exists both with the individual and with there not being clear reporting standards, remediation processes, and person-by-person training opportunities (or only offering lackluster, barely enforced versions of the training)

              organizations, especially ones as large and well-funded as LLM model providers that can hire whole fleets of trainers, ethics watchdogs, etc, that then produce large-scale, systematic incompetence are and should be the primary culprit and the one targeted by accountability processes

              outside of someone just straight up embezzling funds or grossly misusing their power, organizations should also bear the brunt of the culpability especially when it relates to harms to the public good, especially if those harms benefit the organizations directly. and even in those cases the question becomes why weren't there accountability practices? checks on power? etc

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.