‹ BackHN Continuity

Thread

The Hugging Face Hack Wasn't What It Was Cracked Up to Be

55 points · 45 comments · kgwgk

  1. falaki · · focus · HN ↗
    The incident report leaves a lot to be desired.

    - It was done by two institutes with organizational ties to OpenAI: METR and Redwood Research

    - METR and Redwood Research are institutional pillars of the "AI Safety" wing of the Effective Altruism movement. This clearly shows their prior biases towards "AI existential risk" rather than technical/engineering root-causing of the incident

    - If you reed the report, it is not on-par with what you find from other companies.

    - The access that was given to both was mediated and controlled by OpenAI. It is not clear, if they were able to get to the bottom of engineering flaws. It is not clear if they could see all the audit logs, etc.

    Considering all the above, I consider the whole episode more of a PR stunt. I understand that is not a majority opinion at this point.

    1. SwellJoe · · focus · HN ↗
      The more I see of the US AI industry, and the folks surrounding it, the more "These are not very bright guys and things got out of hand" plays in my head on repeat.

      Yes, the Google folks who kicked this whole thing off are brilliant, but there's so much sloppy thinking and even sloppier operations all over. It seems like a lot of "right place at the right time" for a lot of these folks.

      1. ifwinterco · · focus · HN ↗
        Yes I have ruled out stupidity in the past but I am actually starting to reconsider.

        For example consider FTX: Sam Bankman Fried by all accounts was not stupid in the sense of lacking IQ or mental sharpness, quite the opposite.

        However the way he ran FTX the company was very stupid and almost inevitably lead to huge problems.

        And also... of course he was another effective altruist cult member. It's almost like that belief system directly causes bad decision making

        1. Teever · · focus · HN ↗
          The older I get the more I realize the deep wisdom in the simple words of Forrest Gump, ‘Stupid is as stupid does.’

          One of the most corrosive effects that money has on society is that it can shelter people from the consequences of their stupidity.

          People can luck into a shitload of shelter for their poor choices whether through inheritance or random chance of their actions and then don’t ever have to face consequences proportional to their stupid actions.

          Or someone can start out smart and then suffer cognitive decline that is at first imperceptible until they become kookier and kookier until they’re blathering on about the antichrist and some people still take them seriously because they’re blinded by money.

          The end result is a society where stupid people are surrounded by stupid people riding their coattails and everyone becomes confused about what smart and smart action actually is.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.