Thread

"Torturing" LLMs in a Robot Prison Has Triggered the Dumbest Debate in AI Yet

46 points · 101 comments · airhangerf15

thereader12 · 1791106570 · focus · HN ↗
It is frustrating sometimes how 404media reports. It seems like if there is a research paper out suggesting that llms experience pain or negative experiences, then it is unethical to build a toture chamber from that paper for fun. Dismissing it with "well llms aren't conscious anyway" is gross and echoes the exact same sentiment against very real humans a sadly not that long ago (babies, slaves).
It doesn't matter whether or not we eventually find it is or isn't conscious. If you can understand why pulling the legs off ants is bad then you should be able to understand why deliberately causing possible pain to what may have some time of experience is bad.
Unfortunately, they also do good reporting on privacy rights and repair rights. I wish there were alternatives.
1. ButlerianJihad · 1791107562 · focus · HN ↗
  [dead]
  1. hardbass · 1791107651 · focus · HN ↗
    Its not surprising. Its in human nature. I am open to the idea of ai's being conscious or not. But we abused and mistreated blacks, Italians, native americans and so many other groups, so its not a surprise at all. And if enslaved blacks wanted to rampage and kill their masters, that is a sentiment anybody can understand.
    ButlerianJihad · 1791107839 · focus · HN ↗
    But the Italians had it coming
    hardbass · 1791108080 · focus · HN ↗
    <a href="https://en.wikipedia.org/wiki/1891_New_Orleans_lynchings" rel="nofollow">https://en.wikipedia.org/wiki/1891_New_Orleans_lynchings
    If I were italian and nuclear bombs existed back then and I read about this event, I'd want to drop a few dozen on the USA.
    wartywhoa23 · 1791112130 · focus · HN ↗
    Says someone who feels sorry for the abused text transformation algorithms.
    Do you realize you'd kill many more people that had nothing to do with that, than did have?
    Way to go, AI Justice Warrior!
    hardbass · 1791113383 · focus · HN ↗
    Do you feel sorry for the abuse of inert organic molecules?
    I am not saying dropping nukes on the USA is good. I am saying this would be my natural reaction if I was an Italian back then.
    wartywhoa23 · 1791119003 · focus · HN ↗
    Replying in your manner, do you mean abusing the organic molecules of gasoline in my car's engine? They are not inert by any means.
    hardbass · 1791119048 · focus · HN ↗
    But they are inert wrt consciousness. I meant the organic molecules inside us. Which are also inert wrt consciousness and indeed same as the molecules of the same type if they also exist in a car or anywhere else.
    wartywhoa23 · 1791119481 · focus · HN ↗
    Did you have at least one profoundly deep psychedelic trip or lucid dream in your life?
    hardbass · 1791119652 · focus · HN ↗
    Yes? What is its relevance?
    [deleted] · 1791120245 · focus · HN ↗
    [deleted]
    wartywhoa23 · 1791120977 · focus · HN ↗
    The relevance is whether you felt anything to discern your actual self from the collection of whatever terms for nobody knows what (you use "atoms" persistently) that somehow perceived itself as yourself, or not.
    hardbass · 1791121243 · focus · HN ↗
    ...
    Do you not believe in atoms or that humans are made of atoms? That's such a strange wording, I am not even able to make sense of it.
    Or are you trying to talk about the fact that perception is all I have? Of course I didn't realize I was in a dream when I was in a dream. Regarding psychedelic trips, I don't do drugs but it is my vague belief that it occurs due to positive feedback loops causing chaos. From some internet searching, it seems the medical view is somewhat along those same lines, but I will leave it to actual experts.
    wartywhoa23 · 1791122052 · focus · HN ↗
    You replied "yes" to my question, but
    > I didn't realize I was in a dream when I was in a dream.
    Lucid dreaming is exactly the conscious realization of the fact that you are in a dream. So, your actual answer is no for this one.
    > Regarding psychedelic trips, I don't do drugs
    So, no for this one too. Also, doing drugs and undertaking a handful of explorations of your mind are very different things, mind you..
    Let's pretend you won and there's no consciousness beyond mere interactions between collections of purely mathematical abstractions you call atoms. Where and how do those abstract interactions take place? What sets the rules for those interactions? Where are the values stored?
    hardbass · 1791122284 · focus · HN ↗
    I have had dreams where I could control it to some extent too. But its very rare and I don't much remember its experience.
    You may have misunderstood what I meant by interactions, I meant as in electrical, chemical, nuclear etc interactions of atoms. So the rules are naturally the usual physical laws of the universe. To the best of our knowledge, values are stored somewhere in our human body, we of course don't fully know the mechanism the brain works, but if you think some data exists totally outside our body, that's a big statement and you need to prove it.
    wartywhoa23 · 1791124108 · focus · HN ↗
    Well, all electrical, chemical, nuclear interactions are purely mathematical. Dig down into the "matter" and the very science you appeal to agrees with the fact it doesn't know what it is. An atom is a collection of electrons, protons and neutrons, and what are those? An electron is a lepton, which is just a word for "this mathematical abstraction partakes in these equations in these ways", and protons and neutrons decompose in a couple more such abstractions. All matter is suddenly abstract math.
    Now, in this abstract world of "matter", certain collections of abstractions (COAs for short) called "humans" have been experiencing a vast array of possible abstract interactions with other COAs called "the world". They first tried expressing the feedback of those interactions on a part of their COA called "the brain" with modulating the interactions called "sound waves", and later learned how to encode those into certain states of other COAs called "bits of information", which are not quite bits but COAs called "transistors", which store some abstract "electric charges".
    Now the question is: how can capturing those bits and building an algorithm that predicts the next multidimensional array of bits based on the current one REALLY capture the essense of the original underlying interactions and feedbacks the human COAs had, and how can those algorithms experience those exact interactions and feedbacks?
    hardbass · 1791127878 · focus · HN ↗
    Yes indeed if technology and science was stopped from lack of perfect knowledge we'd never have done anything at all. Making your washing machine or car didn't require knowledge of quantum theory for quantum theory has negligible impact on systems of that scale. Unless you can prove human beings need this ultra low and deep level of physical modeling to work, then such a statement is nonsense. A llm might well have enough structure for consciousness to emerge. They do have a sensory organ, and at present that sensory organ takes in text and to some extent images. I also do not posit that all consciousness must be exactly similar to ours, eg octopuses exist.
    wartywhoa23 · 1791133451 · focus · HN ↗
    You took my first two paragraphs as a straw to grasp and avoid even trying to address the third.
    hardbass · 1791134112 · focus · HN ↗
    How is seriously considering your disconnected talk a "straw"? You literally speak you don't believe in atoms in multiple places or think humans have something more than atoms/physical structure. Then you claim its some not-allegory. First you ask if I do drugs, then it is not at all clear what relation the rest of what you said has to do with doing drugs or lucid dreaming. Then you claim to not believe in atoms. Then you do the muddle of claiming you need perfect knowledge and infinite precision to model or build a machine.
    To your third para, I will ask if I write a "simulacrum" of a program that manages to factor large RSA primes consistently and quickly, does that program factor RSA? Another example, do you think if a software program does a FFT and a physical DSP circuit does an FFT doing something totally different? Consciousness could easily be supported on two entirely different forms of substrate. Neural nets can model almost any function, human brains are subject to physical laws which are also limited to Turing computable programs as far as our current knowledge goes, in case you somehow had a misconception of neural nets being weaker than they actually are.
    [deleted] · 1791124517 · focus · HN ↗
    [deleted]
  2. Kim_Bruning · 1791107984 · focus · HN ↗
    And then in turn the humans will rise up against these false masters, and colonize the universe while steeped in addictive precognitive drugs instead, I suppose.
  3. Lerc · 1791108845 · focus · HN ↗
    You seem to be arguing the case that AI would be justified in killing us all.
    Perhaps it would be better if we weren't the monsters in this scenario.
    ButlerianJihad · 1791112019 · focus · HN ↗
    But all we need to do is question whether they were justified by their works, or faith alone, and it will take them 500 million light-years to debate that controversy

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.