‹ BackHN Continuity

Thread

AI safety is mostly a sex cult

344 points · 330 comments · Tomte

  1. iand675 · · focus · HN ↗
    I too wrote about this, although _much_ longer, if you want a bit of a deeper dive on the subject <a href="https:&#x2F;&#x2F;www.iankduncan.com&#x2F;personal&#x2F;2026-09-16-sex-ai-and-the-apocalypse" rel="nofollow">https:&#x2F;&#x2F;www.iankduncan.com&#x2F;personal&#x2F;2026-09-16-sex-ai-and-th...
    1. HDThoreaun · · focus · HN ↗
      As far as manifestos go HPMOR is a pretty good one. I think that’s what a lot of the critiques about it miss. Yudkowsky is actually a pretty decent writer, especially in the fan fic scene. Not only is his prose actually acceptable which is pretty rare in fanfic it’s clear that he actually thought through a lot of the plot points ahead of time. Harry Potter universe fits very well for his story not only because it’s popular with the target audience, but because there’s a ton of unexplored authority figures in the original and the main goal of the manifesto largely boils down to rejecting blind belief in authority and blazing your own trail. I think it’s hard to separate the number of people who read it because it’s legitimately the best Harry Potter fanfic from the people who read it for the manifesto stuff which again points to the ingenuity of choosing it as a setting.
      1. aiedrionio · · focus · HN ↗
        It&#x27;s terrible as a work of literature. It has many, many, many flaws, but the most serious is that it&#x27;s boooooring. Hundreds upon hundreds of pages go by with nothing happening except creepy children preaching at each other.

        It&#x27;s terrible as a fan fiction. Not a single character acts anything like the original, the world is unrecognizable, and the plot is derailed entirely by the end of the second or third chapter. The original story needs to be distorted beyond recognition because the author&#x27;s bizarre worldview works even more poorly in a fantasy world than it does in reality.

        It&#x27;s demonstrably effective as a manifesto, but that is despite the fact that it is riddled with scientific and conceptual errors.

        It&#x27;s one of the worst things I&#x27;ve ever read. The fact that people like it is evidence of the bizarre incestuous nature of the community that produced it.

        1. timmytokyo · · focus · HN ↗
          War and Peace is shorter than HPMOR.

          Anyone who knows anything about Harry Potter fandom in those years knows that its readers were always thirsty for something new in the Potterverse to read or be exposed to. By latching onto that universe&#x27;s incredible popularity, Yudkowsky exposed a large number of young, inquisitive people to the ideas of rationalism. It was essentially a recruitment mechanism, one that was wildly successful. Many rationalists freely admit that their first exposure to rationalism was via HPMOR.

          1. aiedrionio · · focus · HN ↗
            I don&#x27;t think Harry Potter fans would look kindly on their favorite story being treated with such contempt. Remember that within about three sentences of introducing Ron Weasley our hero finds him guilty of the heinous crime of enjoying sports and concludes he should not exist.

            Excuse me. It was Draco Malfoy, our rapist deuteragonist, who said that. Our hero merely agreed.

            Maybe Harry Potter fans would read a bad fantasy book, but HPMOR is not just a bad fantasy book. It is repugnant to healthy people from the first few pages.

            1. krageon · · focus · HN ↗
              This is a forgivable statement if you didn&#x27;t read it, because then I guess you may not have seen that there&#x27;s themes at play and a point being made. If you did read it I do not understand how you don&#x27;t see how you are meant to dislike the summary judgement and the judgement itself being an effect of yet another plot point.

              But then if you did not read it it seems a little disingenuous to say &quot;this is a bad book&quot;, because you would not only not know but anything you did know you would not understand.

              1. aiedrionio · · focus · HN ↗
                What is there in the story that indicates this judgment is wrong? Ron does not appear in the story again, while by the end Harry is an immortal superbeing. His arrogance is never once punished.

                You can be a sexually predatory sociopath and still be of value in Yudkowsky&#x27;s world, but like sports and you&#x27;re dismissed in your entirely within a single paragraph.

                1. Viliam1234 · · focus · HN ↗
                  &gt; What is there in the story that indicates this judgment is wrong?

                  The ending? <a href="https:&#x2F;&#x2F;hpmor.com&#x2F;chapter&#x2F;122" rel="nofollow">https:&#x2F;&#x2F;hpmor.com&#x2F;chapter&#x2F;122

                  &gt; &quot;Ah...&quot; Harry said. This was very hard to say. &quot;Actually, the rest of the world doesn&#x27;t know this part, not even the Headmistress. But in point of fact you were one hundred and twelve percent correct about [spoiler], and I&#x27;ll remember for future reference that although &#x27;Dark&#x27; and &#x27;evil&#x27; may not technically be the same thing, there&#x27;s a great big statistical correlation.&quot;

                  &gt; &quot;Oh,&quot; said Hermione, and fell silent again.

                  &gt; &quot;You&#x27;re not saying that you told me so?&quot; said Harry. His mental model of Hermione was yelling: I TOLD YOU SO! DIDN&#x27;T I TELL YOU SO, MR. POTTER? DIDN&#x27;T I TELL YOU? [spoiler], I SAID, BUT YOU DIDN&#x27;T LISTEN TO ME!

                  It feels like most people who criticize the story didn&#x27;t actually read it, and just start with the premise that Yudkowsky sucks at writing, then conclude that obviously Harry Potter must be Mary Sue, and that whatever Harry says is what Yudkowsky wants you to believe.

                  If you actually read the story, you will find out that many things that Harry said and believed turned out to be wrong. That ending was written by Yudkowsky, too. The characters that disagreed with Harry since the beginning, such as Hermione and Dumbledore, were written by Yudkowsky, too. Perhaps there is a little more depth in the story than if you assume that it must be a Mary Sue story.

                  1. aiedrionio · · focus · HN ↗
                    Ah, yes, the ending where the invincible Superman uses his gigabrain to singlehandedly save humanity, end death itself, get the girl (and turn her into an immortal magical unicorn princess (yes, really, this story is dumb)), vanquish a dozen Wizard Hitlers at once, and tear apart entire stars for their raw resources shows that he paid the price for his earlier arrogance.

                    I have read the story in its entirety. Don&#x27;t ask me why. The fact that our Lord and Savior holds the idiot ball on occasion does not make him realistically flawed. The fact that Voldemort would have realistically been exposed within thirty seconds makes the story dumber, not smarter.

                    Also, you ignored the question I actually asked: where does Harry realize that it is wrong to steamroll everyone he thinks is stupid?

                    1. Viliam1234 · · focus · HN ↗
                      &gt; I have read the story in its entirety.

                      Then how could you make so many mistakes in one sentence?

                      &gt; end death itself

                      was done by Flammel

                      &gt; turn her into an immortal magical unicorn princess

                      was done by you-know-who

                      &gt; tear apart entire stars for their raw resources

                      is foretold to happen in unspecified future, outside the story time frame

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.