‹ BackHN Continuity

Thread

OpenAI's Sam Altman to Brief UN Security Council Next Week

49 points · 69 comments · layer8

  1. wewewedxfgdf · · focus · HN ↗
    I find it very hard to understand the things these AI CEO's say.

    He will probably get up there and say his companies products will destroy every citizen of their countries.

    1. howunfortunate · · focus · HN ↗
      People will say it's marketing but I find Occam's Razor highly favors the theory "they are true believers in AGI/ASI"

      This seems especially true for Anthropic employees.

      1. moshun · · focus · HN ↗
        Wouldn’t Occam’s razor say that the people speaking are highly motivated to continue being paid? Relying on their fear of future outcomes seems to be misplaced to judge the honesty of their statements.
        1. howunfortunate · · focus · HN ↗
          > continue being paid

          What I mean by Occam's Razor:

          There are many assumptions that need to be true to link "they say they're terrified of AI" to "they get paid more / longer", in both their own minds and everyone else's. It's a bit of 4D chess that could go their way, but also could go 100 different ways.

          In contrast, linking "they say it" to "they believe it" is simple.

          1. layer8 · · focus · HN ↗
            Justifying “they believe it” isn’t so simple, however.
          2. bheadmaster · · focus · HN ↗
            Occam's razor is about minimizing the number of assumptions needed for a conclusion. In this case, "they believe it" is the same number of assumptions as "they get paid" - just one.
            1. howunfortunate · · focus · HN ↗
              Saying "I'm terrified of my job" does not normally lead fo getting paid more. Those links are the extra assumptions.
              1. bheadmaster · · focus · HN ↗
                An assumption is something that we can't know, yet assume is true for the sake of coming up with a theory. What we're assuming here is their intention.

                The implication (or as you said, "the links"), that talking about how dangerous their product is leads to more money, is true regardless of their intention. They create hype, they get money, that's not an assumption, that's an observation.

                The question is only if their intention was to make money, or are they speaking from the heart. That's the assumption we choose.

                1. howunfortunate · · focus · HN ↗
                  > They create hype, they get money, that's not an assumption, that's an observation.

                  Because we can't observe the counterfactual world, this actually is just an assumption.

                  Diving their intention also still requires many assumptions about their intermediate beliefs that I find dubious

                  1. [deleted] · · focus · HN ↗

                    [deleted]

                  2. bheadmaster · · focus · HN ↗
                    > Because we can't observe the counterfactual world, this actually is just an assumption.

                    If you discard all empirical claims categorically due to "inability to observe the counterfactual world", your own reasoning falls apart. Why would you assume people mean what they say?

                    > Diving their intention also still requires many assumptions about their intermediate beliefs that I find dubious

                    You're assuming CEOs of multi-billion dollar companies are honest. I find that dubious.

                    1. howunfortunate · · focus · HN ↗
                      > If you discard all empirical claims categorically due to "inability to observe the counterfactual world"

                      I don't.

                      There are a lot of counterfactuals we can observe empirically.

                      I'm just saying there is no empirical evidence to support the marketing strategy of "tell people our product is going to kill their families". I believe this is the first time it's been tried out.

                      1. bheadmaster · · focus · HN ↗
                        No, this is not the first time. Scaremongering by frontier AI CEOs has been going on since ChatGPT came out, every time with a massive investment following.

                        OpenAI got $10 billion from Microsoft after Sam Altman claimed AI could lead to extinction of humanity.

                        Anthropic got similar multi-billion dollar funding from Amazon and Google after warning AI could develop biological weapons.

                        xAI got similarly massive funding after Elon Musk predicted a terminator-style future.

                        If you don't accept this as "empirical evidence", then there's nothing to discuss.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.