Thread

1. digitaltrees · 1790530079 · focus · HN ↗

   I think any argument that this is a cynical attempt at regulatory capture is destroyed by this; the economic incentives of releasing more capable models are too large. I might be persuaded that they are actually running out of money, and this is really just a cover for reducing burn..

   I welcome this though, I think the models are smart enough for broad economic activity and we could spend a few years simply working to integrate them into workflows and letting society adjust. More intelligence isn't necessary for meaningful impact and the risks that are obvious and present and unsolved aren't worth the cost benefit analysis.

   1. surgical_fire · 1790530691 · focus · HN ↗

      There's a simpler explanation. Maybe their next models doesn't offer a meaningful improvement.

      Instead of releasing something that is incredibly expensive and gets a lackluster reception, you can delay it and clail something scary about rogue agents.

      Those assholes have been ramping up on the doomerist narrative for months. That people still fall for this crap is baffling.

      1. digitaltrees · 1790531473 · focus · HN ↗

         Why is it crap? What would happen if the models dropped the database to Medicaid? Hundreds of billions of dollars of revenue would evaporate from the medical system immediately causing massive chaos. What if they accidentally DoS the interbank settlement system so the financial markets freeze? Modern society is highly fragile to disruptions. How much food storage do you personally have? How many days do you think grocery stores would have food if there was an interruption?

         1. surgical_fire · 1790533103 · focus · HN ↗

            Are you giving all these possibilities because of the HuggingFace attack?

            Buddy, that was gross negligence from OpenAI. Deliberate gross negligence if you ask me.

            Those models are not automous as you presume. If someone taks them of dropping the Medicaid database, the people or companies behind that instruction should be punished.

            "What if someone makes a bomb attack on a government building?" Is the same sort of questioning of the possibilities you are raising. If something like that happens, criminals should be punished.

            1. digitaltrees · 1790540740 · focus · HN ↗

               I am not your buddy, guy. But seriously, they have the ability to do everything I listed do they not? Thats actual risk not hypothetical risk.

               You are missing the whole point. They have the ability to act in ways no one intended or could reasonably anticipate. So unless you are advocating blocking all terminal access, web access or human approval of every tool call there is no way to prevent this risk

               1. surgical_fire · 1790541795 · focus · HN ↗

                  > I am not your buddy, guy

                  Fair, I will refer to you as moron then.

                  I didn't bother to read your words beyond that point.

                  1. digitaltrees · 1790545000 · focus · HN ↗

                     That’s a South Park reference. Lighten up. Debates can be civil even when there is disagreement.

Unofficial Hacker News client; not affiliated with Y Combinator.