‹ BackHN Continuity

Thread

LeCun has "zero concerns" about AI wiping out humanity, recent "rogue" incidents

400 points · 756 comments · Anon84

  1. lukewarm707 · · focus · HN ↗
    Per <a href="https:&#x2F;&#x2F;trace.manifund.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;trace.manifund.org&#x2F; a total of $2,846,125,859 USD has been wired into &#x27;ai safety&#x27; causes, many involving ai consciousness and p(doom).

    The outcome of this &#x27;safety&#x27; is restricting public access to AI and giving a monopoly of access to the industry. This is the ai nonprofit-industrial complex actively concentrating monopoly power in Anthropic in particular as creator, interpreter and safety regulator of AI.

    Much of the $2.8bn listed is indirectly, from Anthropic and EA. Three of the four people who participated in the $125m Anthropic Series A are now folding their 1000x Anthropic return into AI &#x27;safety&#x27;. Some is from FTX&#x2F;Alameda, which invested 86% of the Series B.

    Dustin Moskovitz: Facebook&#x2F;Asana&#x2F;Anthropic Series A, funds EA Good Ventures, transferred to Coefficient Giving, then $1.5bn into ai safety. $500m of Anthropic into an unknown foundation. Funding: $160m to Resolution (alignment research), $93m to Epoch AI (investigating the trajectory of AI), $63m to Redwood Research (oai report), $67m to MATS ( EA type alignment and security researchers), Institute for AI Policy and Strategy, Fund for Alignment Research, $53m to Kairos (building talent infrastructure for AI safety), $32m to Bluedot (online safety courses), $15m to MIRI (Yudkowsky).

    Jaan Tallinn: Led the Series A, now $10bn in Anthropic. Funds $199m (85%) of the Survival and Flourishing Fund, then $161m to AI safety including $14m to lightcone (Lesswrong, Lighthouse). $10m to BERI (existential risks), Palisade Research (studying AI capabilities to prevent loss of control.) PauseAI, MIRI, METR etc. Much of what Coefficient funds.

    Eric Schmidt: Anthropic Series A, $72m to AI safety via Schmidt Sciences. Over $1m per individual AI2050 researcher.

    FTX: Led the Anthropic Series B, bankruptcy estate sold $884m of Anthropic in 2024; $40m to AI Safety. Same orgs, Redwood, Lightcone, etc.

    Ruairí Donnelly (Chief of Staff FTX): FTX tokens plus assorted donors, $91m to AI safety via Macroscopic Ventures. $15m to Cooperative AI (currently whitewashing openai under &#x27;multiagent safety&#x27;)

    1. api · · focus · HN ↗
      There&#x27;s absolutely no way these companies can justify their insane valuations unless they can legislate a barrier to entry and create an oligopoly.

      There&#x27;s no moat. I can literally sit here in Zed or Pi or any other third party harness and switch models in the middle of a task and it&#x27;s typically fine. Sometimes a model will get stuck and that&#x27;s just what I&#x27;ll do.

      Combined with competition and open weights models, that means the price is going to go to fall until AI tokens cost a small premium over the cost of the hardware and electricity.

      That&#x27;s assuming improvements in algorithms and specialized silicon doesn&#x27;t eventually lead to an efficient accelerator that can run a frontier model locally. It&#x27;ll be a while but I don&#x27;t see any fundamental barrier. High bandwidth flash storage is coming, and that&#x27;ll radically cut the RAM side of that cost. Pair that with a pipelined TPU accelerator and you&#x27;re cooking.

      Now look at Anthropic&#x27;s proposed IPO valuation. It&#x27;s insane unless they can own the market or share it with a cartel of maybe 1-2 other behemoths, and this is the only way they can do that.

      1. Loquebantur · · focus · HN ↗
        That is certainly part of the motivation for the big US AI brands to engage in calling their inept developer mistakes &quot;AI breaking loose&quot;.

        But that doesn&#x27;t take away from the real issues and dangers AI poses?

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.