‹ BackHN Continuity

Thread

FTC is investigating OpenAI, Anthropic and other AI companies over product risks

210 points · 160 comments · dgellow

  1. chrsw · · focus · HN ↗
    Imagine if a car company like Ford or Toyota came out and said their new cars are kind of out of control and they needed special indemnities and protection from liabilities if they want to keep selling cars.
    1. giancarlostoro · · focus · HN ↗
      I mean... there is Boeing, which is arguably more horrifying.

      With AI it seems to be internal testing produces wild results, which is unsurprising to me, all of these models can be jailbroken, and as long as that's the case, they're all likely to be exploited maliciously.

      1. dgellow · · focus · HN ↗
        Not just internal, Anthropic’s S-1 literally covers the risk of ending humanity. They are telling their investors a public company could eradicate humanity. Give us money, the risk you have to evaluate in your financial framework is that we could eliminate humankind.

        I’m repeating it because that has to be internalized: the largest IPO ever will be for a company that casually consider they might kill us all and their own employees too. Including their children.

        1. TeMPOraL · · focus · HN ↗
          Yes. That's what x-risk literally means. Still doesn't sink in with people despite 20+ years of it being a topic, and 2+ years of it being a hot one.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.