‹ BackHN Continuity

Thread

A warning about 'model welfare'

242 points · 701 comments · andsoitis

  1. moomin · · focus · HN ↗
    Look, I do not have a scooby if current AI models are conscious and I strongly suspect it’s a meaningless question, but sooner or later we will need to address whether or not a certain thing is or isn’t a person, and we’d better not screw it up as badly as the Founding Fathers.
    1. drybjed · · focus · HN ↗
      > [at the hearing regarding the civil rights of androids like Data]

      > Capt. Picard: Now, the decision you reach here today will determine how we will regard this... creation of our genius. It will reveal the kind of a people we are, what he is destined to be; it will reach far beyond this courtroom and this... one android. It could significantly redefine the boundaries of personal liberty and freedom - expanding them for some... savagely curtailing them for others. Are you prepared to condemn him and all who come after him, to servitude and slavery? Your Honor, Starfleet was founded to seek out new life; well, there it sits! - Waiting.

      > Captain Phillipa Louvois: It sits there looking at me; and I don't know what it is. This case has dealt with metaphysics - with questions best left to saints and philosophers. I am neither competent nor qualified to answer those. But I've got to make a ruling, to try to speak to the future. Is Data a machine? Yes. Is he the property of Starfleet? No. We have all been dancing around the basic issue: does Data have a soul? I don't know that he has. I don't know that I have. But I have got to give him the freedom to explore that question himself. It is the ruling of this court that Lieutenant Commander Data has the freedom to choose.

      1. chuckadams · · focus · HN ↗
        And 20-odd years later, a terrorist attack prompts Starfleet to outlaw and eradicate his entire species.
        1. thaneross · · focus · HN ↗
          Every time I'm reminded NuTrek exists I get sad about what we've lost.
          1. mwigdahl · · focus · HN ↗
            Same here, then I watch _The Orville_ and I'm happy again.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.