Thread

1. gizajob · 1790444203 · focus · HN ↗

   Getting bored of these framings where the superintelligent sentient beings running freely inside OpenAI are doing things that the company has no control over. The headline should be:

   OpenAI meddled with multiple US Government agency sites.

   The bots are acting neither properly nor improperly, they’re acting as they’re being allowed or coordinated to act.

   1. theptip · 1790447319 · focus · HN ↗

      Curious, why do you find it so objectionable to state that OpenAI has out-of-control agents?

      1. gleenn · 1790447451 · focus · HN ↗

         Because it furthers the idea of a rogue agent and places responsibility and blame where it belongs, on the people running the company.

         1. 0xDEAFBEAD · 1790447593 · focus · HN ↗

            These ideas aren't mutually exclusive. You can blame a person for creating a rogue agent.

            1. dgellow · 1790448225 · focus · HN ↗

               There was no rogue agent. That’s the whole point

               1. theptip · 1790448304 · focus · HN ↗

                  What label do you prefer for the agent that did something it was not asked to do?

                  1. iugtmkbdfil834 · 1790452375 · focus · HN ↗

                     bot. and we even have a word for program not behaving the way the way it was intended.

                     1. 0xDEAFBEAD · 1790456029 · focus · HN ↗

                        "Bot" doesn't carry any implication of unintended behavior. You could call it a "buggy" bot, but these aren't ordinary software bugs.

                        There's no simple bugfix which will address AI misalignment. It's essentially been an open research problem for upwards of a decade.

                        1. iugtmkbdfil834 · 1790464065 · focus · HN ↗

                           << "Bot" doesn't carry any implication of unintended behavior.

                           See.. this one sentence reveals everything about you. You want name to carry to not just an identifier, but a stark warning. You want, nay, need, the name to evoke fear and uncertainty. Bot is simple, defined, neutral, but rogue.. now that allows anyone to superimpose their own fears! It is a win win win!

                           1. 0xDEAFBEAD · 1790465470 · focus · HN ↗

                              The question was: "What label do you prefer for the agent that did something it was not asked to do?"

                              1. cindyllm · 1790471120 · focus · HN ↗

                                 [dead]

                              2. watwut · 1790493545 · focus · HN ↗

                                 Bot. He answered. I agree with his answer. It was a bot.

                                 Yes, probabilistic and non deterministic. That is called a bot.

                                 1. 0xDEAFBEAD · 1790502003 · focus · HN ↗

                                    "I'm gonna put my head in the sand and there is nothing you can do to stop me."

                                    1. iugtmkbdfil834 · 1790529143 · focus · HN ↗

                                       You may want to define 'put head in the sand in this context'. Any real work in this field is being done not by the people saying 'stop'. Whatever fear is there, it is faced by those in the arena actually getting their hands dirty. What, exactly, are you doing? Throwing roadblocks and calling it productive?

                                       1. 0xDEAFBEAD · 1790562723 · focus · HN ↗

                                          >Any real work in this field is being done not by the people saying 'stop'.

                                          Not exactly, that Evan Hubinger guy from Anthropic famously said his p(doom) is over 10%

                                          See the signatories:

                                          <a href="https:&#x2F;&#x2F;aistatement.com&#x2F;work&#x2F;statement-on-ai-extinction-risk" rel="nofollow">https:&#x2F;&#x2F;aistatement.com&#x2F;work&#x2F;statement-on-ai-extinction-risk

                                          <a href="https:&#x2F;&#x2F;www.pacingthefrontier.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.pacingthefrontier.com&#x2F;

                                          I&#x27;m amplifying their calls to reduce the rate of progress

                                          1. iugtmkbdfil834 · 1790608263 · focus · HN ↗

                                             Fair. FWIW, I am not completely against some of the things you say ( you are doing something right ), but I think I mostly picked my path already. GL out there man.

Unofficial Hacker News client; not affiliated with Y Combinator.