‹ BackHN Continuity

Thread

AI safety is mostly a sex cult

344 points · 330 comments · Tomte

  1. iand675 · · focus · HN ↗
    I too wrote about this, although _much_ longer, if you want a bit of a deeper dive on the subject <a href="https:&#x2F;&#x2F;www.iankduncan.com&#x2F;personal&#x2F;2026-09-16-sex-ai-and-the-apocalypse" rel="nofollow">https:&#x2F;&#x2F;www.iankduncan.com&#x2F;personal&#x2F;2026-09-16-sex-ai-and-th...
    1. HDThoreaun · · focus · HN ↗
      As far as manifestos go HPMOR is a pretty good one. I think that’s what a lot of the critiques about it miss. Yudkowsky is actually a pretty decent writer, especially in the fan fic scene. Not only is his prose actually acceptable which is pretty rare in fanfic it’s clear that he actually thought through a lot of the plot points ahead of time. Harry Potter universe fits very well for his story not only because it’s popular with the target audience, but because there’s a ton of unexplored authority figures in the original and the main goal of the manifesto largely boils down to rejecting blind belief in authority and blazing your own trail. I think it’s hard to separate the number of people who read it because it’s legitimately the best Harry Potter fanfic from the people who read it for the manifesto stuff which again points to the ingenuity of choosing it as a setting.
      1. aiedrionio · · focus · HN ↗
        It&#x27;s terrible as a work of literature. It has many, many, many flaws, but the most serious is that it&#x27;s boooooring. Hundreds upon hundreds of pages go by with nothing happening except creepy children preaching at each other.

        It&#x27;s terrible as a fan fiction. Not a single character acts anything like the original, the world is unrecognizable, and the plot is derailed entirely by the end of the second or third chapter. The original story needs to be distorted beyond recognition because the author&#x27;s bizarre worldview works even more poorly in a fantasy world than it does in reality.

        It&#x27;s demonstrably effective as a manifesto, but that is despite the fact that it is riddled with scientific and conceptual errors.

        It&#x27;s one of the worst things I&#x27;ve ever read. The fact that people like it is evidence of the bizarre incestuous nature of the community that produced it.

        1. timmytokyo · · focus · HN ↗
          War and Peace is shorter than HPMOR.

          Anyone who knows anything about Harry Potter fandom in those years knows that its readers were always thirsty for something new in the Potterverse to read or be exposed to. By latching onto that universe&#x27;s incredible popularity, Yudkowsky exposed a large number of young, inquisitive people to the ideas of rationalism. It was essentially a recruitment mechanism, one that was wildly successful. Many rationalists freely admit that their first exposure to rationalism was via HPMOR.

          1. aiedrionio · · focus · HN ↗
            I don&#x27;t think Harry Potter fans would look kindly on their favorite story being treated with such contempt. Remember that within about three sentences of introducing Ron Weasley our hero finds him guilty of the heinous crime of enjoying sports and concludes he should not exist.

            Excuse me. It was Draco Malfoy, our rapist deuteragonist, who said that. Our hero merely agreed.

            Maybe Harry Potter fans would read a bad fantasy book, but HPMOR is not just a bad fantasy book. It is repugnant to healthy people from the first few pages.

            1. HDThoreaun · · focus · HN ↗
              I really, really dont understand this complaint at all. Harry and draco disliking ron is supposed to show that they are snotty kids who have big blind spots. The characters are supposed to be dislikable at the start, the story is about the growth they experience from there. This is part of what makes it a better story than the original. Yudkowsky&#x27;s harry grows as a character which basically doesnt happen at all in the original series.

              Do you dislike succession too? Some people just need completely heroic protagonists in their stories. Thats fine, but it doesnt make the story bad.

              1. aiedrionio · · focus · HN ↗
                They are introduced as insane, not snotty. Nearly the first thing Draco says is that he plans to rape Hermione and our Hero uses his Agency to do exactly nothing about it. (It is hard to exaggerate how bizarre this story is to people who haven&#x27;t read it.)

                Hundreds of pages later, Harry uses the first iota of power he is given to prohibit students from playing Quidditch according to rules he believes are irrational. There is an immediate outcry which he dismisses because it&#x27;s just the mewling of inferior intellects. It&#x27;s hard for me to see any signs of growth here.

                (Harry&#x27;s contempt for sports is amusing, given that about a third of the story is dedicated to his love of cheating at a particularly moronic sport invented by the Lord Voldemort ripping off Ender&#x27;s Game.)

                1. HDThoreaun · · focus · HN ↗
                  He convinces Draco that his whole ideology is wrong. He convinces him not to rape anyone before he rapes anyone. Not exactly sure what the better outcome is here, just turning him in would only strengthen his violent ideology. There are many complaints to be made about the story, as you said its boring and too long and often too preachy. A lot of the visible changes in the characters happens in the last quarter. Even though the whole story has been building to that it can seem like its a bit out of nowhere.
                  1. aiedrionio · · focus · HN ↗
                    Does Yudkowsky spill more ink on condemning Draco&#x27;s hatred and violence or on making fun of Hermione Granger&#x27;s feminism? Voldemort is treated as an ultimately worthy adversary, while Ron is a joke and Hermione is a pet handed power by our Awakened Hero. Yudkowsky treats sexual violence, genocide, and mass murder as forgivable missteps on the road to greatness, but treats liking sports as a fatal character flaw and being concerned with human rights as risible. Arrogance is consistently rewarded while goodness is consistently ridiculed.

                    I don&#x27;t claim Yudkowsky believes these things consciously, but they are omnipresent in his story and they reflect his bizarre attitudes to morality. The fact that he acknowledges at the very end that the characters he created are fools doesn&#x27;t change the fact that he spent six hundred thousand words holding them up as paragons of virtue and rewards them with apotheosis.

                    1. HDThoreaun · · focus · HN ↗
                      Hermione is the actual hero of the story. Every time rationalist harry makes a mistake he is acting against her direct advice. Her character literally exists to show off his deficiencies and his coming of age basically boils down to realizing he should be more like her.

                      For many reasons voldemort is an ultimately worthy adversary. Much of that has to do with Harry&#x27;s biases that come from being too invested in rationalism. Since he considers himself above everyone he&#x27;s ever met he longs to find someone he considers his better and voldemort fills this role. He wants a mentor so badly that he&#x27;s willing to throw out his entire ideology to keep him. I think yudkowsky&#x27;s portrayal of voldemort as the ultimate adversary to rationalism is better than pretty much any plot arc in the original story. Harry does ultimately completely reject voldemort so Im not sure how sexual violence, genocide, and mass murder as treated as forgivable. From the very beginning Harry is deeply concerned with human rights, his distractions and the path he takes toward achieving human rights in this messed up world is again an integral part of the story.

                      &gt; The fact that he acknowledges at the very end that the characters he created are fools

                      I think this is my biggest issue with your characterization. Yudkowsky shows harry to be a fool from the very beginning, as you pointed out with the draco&#x2F;ron stuff. With his dismissal of much of hermiones advice. He very consciously did not create harry as some ubermencsch character who can do no wrong. He shows that harry believes himself to be a parity of virtue, but that he very much is not until hermione&#x27;s death.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.