‹ BackHN Continuity

Thread

Don't Be Fooled by this Summer of AI Hype

41 points · 37 comments · jacquesm

  1. quicklywilliam · · focus · HN ↗
    Lots of anti-AI takes seem to fall prey to the moralistic fallacy (ie because something shouldn’t be, thinking it isn’t). I’m very skeptical of the claims AI companies make, their motives, and whether their impact will be anything positive. But I am pretty tired of takes like this that are so reflexively skeptical of anything AI that they carelessly dismiss claims about the dangers and real impacts of AI that are happening.

    (And to be clear: I’m not talking about being skeptical of fantastic claims about things that have not happened- ie an AI takeover, runaway super-intelligence, etc.)

    1. autoexec · · focus · HN ↗
      What kind of real evidence about the dangers of AI that are happening do you have that didn't come from an AI company, wasn't about some internal test that conveniently can't be replicated or independently verified, where nobody disabled guardrails that would be in place for typical users, or where they didn't instruct the AI to roleplay as someone doing something evil? What danger are we seeing right now in the real world that people aren't taking seriously?
      1. quicklywilliam · · focus · HN ↗
        The article is very dismissive of recent mathematical proofs. It mixes together ethical problems (plagiarism, &quot;strip mining&quot; proofs) with capability problems (proofs not being novel, overstating capabilities). Again, it&#x27;s fair to be skeptical of what the companies themselves are saying (and why). But from what I&#x27;ve read, many mathematicians are taking AI quite seriously. I&#x27;ve recently read several thoughtful essays from credible folks who are calling for dramatic changes to the field in response. For example: <a href="https:&#x2F;&#x2F;www.daniellitt.com&#x2F;blog&#x2F;2026&#x2F;9&#x2F;13&#x2F;a-beginning-for-mathematics&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.daniellitt.com&#x2F;blog&#x2F;2026&#x2F;9&#x2F;13&#x2F;a-beginning-for-ma...

        The article is also dismissive of the Hugging Face incident and other hacking incidents. This one is trickier, because we are more reliant on what the companies have released to piece together what happened. The METR report is probably the closest thing we have right now. Here again, I think the issue is that a lot of coverage blends the ethical issues (holding AI companies responsible for what their bots do) with capability issues (whether AI is or will be capable of developing novel and dangerous attacks).

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.