Thread

AI Safety Is Mostly a Sex Cult

76 points · 12 comments · olalonde

Loading the complete thread in the background. This saved snapshot is available now. Refresh

epsteingpt · 1789829171 · focus · HN ↗
See also: <a href="https://news.ycombinator.com/item?id=49746654">https://news.ycombinator.com/item?id=49746654
mushi_shi · 1789830018 · focus · HN ↗
The hubris is probably more damning than the fact it's a sex cult. Or at least an incestuous click.
olalonde · 1789830717 · focus · HN ↗
<a href="https://x.com/Aella_Girl/status/1874676723910098955" rel="nofollow">https://x.com/Aella_Girl/status/1874676723910098955
24 showers and 71 crying sessions in a year. That lifestyle doesn't seem particularly healthy...
1. happytoexplain · 1789831312 · focus · HN ↗
  What's the intent of this comment?
  Edit: I.e. are you implying something about the submitted writeup? Or just demeaning her? Or something else?
  1. olalonde · 1789832338 · focus · HN ↗
    To point out the rationalist orgy lifestyle isn't all it's cracked up to be. She kind of sounds depressed.
  2. olalonde · 1789849201 · focus · HN ↗
    She looks depressed.
    happytoexplain · 1789850579 · focus · HN ↗
    Right, I understand the literal meaning of your post. I'm asking about why you posted it.
2. hax0ron3 · 1789831343 · focus · HN ↗
  Having a crying session every 5 days doesn't seem very healthy to me, but showering once every 2 weeks might be fine. I've gone many days without showering many times in my life and nothing bad ever happened to me as a result. I'd usually shower before going out and interacting with people, but when sitting at home there just never seemed to be any point to it. And Aella's showering habits haven't stopped her from reaching her goals, so it doesn't really matter.
  1. tkel · 1789831597 · focus · HN ↗
    It's actually unhealthy that you think it's unhealthy to cry regularly. Perhaps you have trouble processing your emotions and just bottle them up instead, causing them to leak out in other situations or lead to outbursts?
    jawilson2 · 1789831736 · focus · HN ↗
    Here, I was going to say it's actually unhealthy to shower twice a month. This is some super-power nose blindness.
    MrDrMcCoy · 1789875408 · focus · HN ↗
    Not necessarily. Lots of variable factors play into how often a person might need to shower. Temperature, humidity, how prone you are to sweating in general, diet, hormonal balance, skin microbiome. Some months during a dry winter where I'm not doing much, I won't need to shower more than once a week to look and smell decent. When I spent a July in Cambodia, it was multiple times per day. When I was a kid, I barely sweat and once went nearly a month before I or anyone else noticed. As an adult, that is no longer possible.
    There's a guy who discovered a bacterial culture that works better than any deoderant, and for him eliminated the need to use soap on the hair or body. He still showers and uses soap on his hands, but reported that his hair and skin have been so happy and healthy that soap no longer made any sense. Dig into A2-Biome if you're curious.
    hax0ron3 · 1789831815 · focus · HN ↗
    I should clarify. I don't think it's unhealthy to cry every 5 days. I think it might be unhealthy to have the sort of mental state that makes you want to cry every 5 days. It's the underlying psychological situation that might be unhealthy, not the outlet of crying.
    olalonde · 1789833112 · focus · HN ↗
    I haven't cried in years and no outbursts... What makes you cry so often?
an0malous · 1789830877 · focus · HN ↗
I used to read a lot of LessWrong, Yudkowsky, SlateStarCodex. Rationalism is really just another religion, with the faith parts carefully tucked away underneath concepts like priors or how one chooses to construct a model or assign/“update” probabilities. Their god is ASI. Their beliefs have no more fundamental basis in truth than any other faith.
There’s also a fundamental problem with the idea of using models and probabilities for decision making in that one has to choose a model before deducing any facts, and this leads to all sorts of post hoc rationalization. It’s basically just a culture of people with weird preferences coming up with mathy rationalizations for them.
1. glitchc · 1789831477 · focus · HN ↗
  It seems unfair to conflate the rationalism of Berkeley, Locke, Russell and Hitchens who hold critical thinking in the highest regard, to AI maximalists, who seem to be using rationalidm mainly as a cover for their own pet ideas on social reengineering.
  The former is mainly about being true to the scientific process of evidence-led discovery, while the latter is... whatever it is (but rational it is not). From a critical thinking perspective, there is no evidence to suggest the current form of AI could achieve superintelligence, and mechanisms that could enable ASI have not been discovered yet. Their perspective, on the other hand, is far more activist.
  1. an0malous · 1789833456 · focus · HN ↗
    I meant the modern community, I think they adopt the same “Rationalism” name. Basically the LessWrong community but HN is also pretty adjacent.
  2. MrDrMcCoy · 1789875931 · focus · HN ↗
    I think most people who are familiar with proper Rationalism are able to tell it apart from the subject of present-day movements. Those that aren't are right to criticize the harms that they see.
ChrisArchitect · 1789831065 · focus · HN ↗
[dupe] <a href="https://news.ycombinator.com/item?id=49737985">https://news.ycombinator.com/item?id=49737985
miladyincontrol · 1789831987 · focus · HN ↗
A lot of the "AI Alignment" and "rationalism" talk really feels like it echos a lot of alt-right "race realist" talking points, but towards software rather than people from a different region or walk of life. "Ah, my mistake, clearly the outcome was obvious if we let them exist among us."
Granted there's obviously very different impacts between the implied out-groups being software plus those who enable LLMs, versus general populaces or marginalized demographics.
Still, it concerns me especially as it's not too far a stretch for those socially invested in Effective Outrage to turn the other heel when it suits them, it'd be only rational to be.
1. api · 1789859643 · focus · HN ↗
  There’s more overlap between those camps than many would want to admit.
  Neoreaction, “HBD,” and similar movements emerged from some of the same forums. I consider them at least adjacent.
  It’s not that I think AI is all upside. We were naive about the net that way and we shouldn’t repeat the mistake. But it’s a technology and all tech is two sided and dual use. If you make a better hammer most people will build with it but some people will bash people’s heads in with it.
  I think the biggest single problem I have with the AI safety crowd (other than what I consider dodgy reasoning and magical thinking) is that they put all the emphasis on sci-fi scenarios that are at least very unlikely (if not impossible) while ignoring much more likely and even currently real negative uses of AI.
  The AI risks we should be talking about are things like mass manipulation, AI being used to supercharge addiction, a “zero entry level positions” economy that leads to mass unemployment, and monopolization of powerful AI by AI by the rich and powerful.
  The last scenario is one the safety crowd is working to make more likely. Closing off AI research, outlawing open models, forcing all new innovations and models through gates, those are the things that will lead to the most powerful AI being kept back and only made available to the most powerful people.
  I’m not sure rule by immortal trillionaire god-kings wielding superintelligence (while outlawing access to it for the rest) is that preferable to the rise of an “un-aligned” independent superintelligence. It might be worse. I’ll take the bear.
2. subsistence234 · 1789910774 · focus · HN ↗
  in the sense that both are about uncomfortable truths, things we don't want to be true but are true anyway.
  most people care more about their social standing than about truth, so they just lie (including to themselves), no biggie.
  the "AI alignment" people are for example far more open to granting personhood to sufficiently advanced AI systems than others are. it's not hate of AI that drives the alignment discourse, it's a deeper understanding of our shared reality.
  for simpler minds, understanding the risks posed by a superhuman AI is akin to hate, and understanding the degrees of inheritability of various traits is akin to discrimination. simpler minds need the lies in order to not hate, need the lies in order to not discriminate.
  1. cindyllm · 1789914125 · focus · HN ↗
    [dead]
rpcope1 · 1789832196 · focus · HN ↗
One of the many funny things about whatever this group is, if you ask 100 members who E.T. Jaynes is, or some of his follow ons like MacKay or others in the same school of though like Polya, Shore and Johnson, better than 99 out of 100 will have a deer in the headlights look. I would wager the actual intellectual progenitor of a lot of the applied Baynesianism (Jaynes) is rolling in his grave right now.
1. Hizonner · 1789832513 · focus · HN ↗
  You don't know what this group is, but you confidently spew statistics about it?
Hizonner · 1789832325 · focus · HN ↗
This was a stupid waste of time the first time it was posted here.
tosti · 1789833264 · focus · HN ↗
Schizophrenia really messes people up and they can't help it. It's not a disease and the likelyhood of developing it is genetic. Hard drugs can also increase the risk.
piloto_ciego · 1789833454 · focus · HN ↗
This got flagged immediately - but why? There’s nothing I saw in there that wasn’t true?
1. verdverm · 1789833933 · focus · HN ↗
  1. it's a dupe post, there are other commenters who've shared links to prior submissions with more comments (and not flagged)
  2. some of that group hangs around HN, there is an amount of (likely uncoordinated) voting/flagging patterns
  1. piloto_ciego · 1789835187 · focus · HN ↗
    2 seems more relevant here, IMO.
    HN has been kind of wild with influence campaigns over the last 6 months or so?
    verdverm · 1789835431 · focus · HN ↗
    there has always been an amount, I notice it more with Trump related comments since 2.0, but inconsistent
    EA is a newer in frequency topic on HN, so unclear thus far, but the other submissions remain unflagged
    piloto_ciego · 1789842956 · focus · HN ↗
    I just went for a walk, sorry it took me so long to reply.
    But yeah, I've seen a TON of stuff that seems brigaded or astroturfed or otherwise like it's manipulation? The EA / TESCREAL stuff maybe is just the latest weird one? I don't know, but generally, I wish there were a lot more hopeful views of the world.
    Like, we can live in a badass robot powered solar punk utopia if we decide to, but everyone I guess would rather daydream about skynet.
    verdverm · 1789846448 · focus · HN ↗
    > Like, we can live in a badass robot powered solar punk utopia if we decide to, but everyone I guess would rather daydream about skynet.
    Agree!
    - there's a newer cozy game called "solar punk" if you need an escape
    - the badass version is where non-Western countries are largely at, it's the West and its dysfunctional media ecosystems are suck in a doomer loop we have to endure here
    piloto_ciego · 1789851721 · focus · HN ↗
    That's what I'm trying to build, at least my Alaskan version of it. Off grid cabin, robots zipping around, and solar lol. We'll see how it works out? I don't know, also, building stuff is tough, but I'm learning.
    I'll try the game out, thanks for the rec.
2. VCFundedGenYer · 1789834336 · focus · HN ↗
  It's a dupe and was a story last week.
3. IshKebab · 1789843817 · focus · HN ↗
  How about the title?
tim333 · 1789834375 · focus · HN ↗
AI safety is not the same as all the Yudkowsky weirdness.
1. timmytokyo · 1789855930 · focus · HN ↗
  The Venn diagram has huge overlap.
  1. tim333 · 1789919508 · focus · HN ↗
    On HN it seems to have that. On the other hand in the Wikipedia article <a href="https://en.wikipedia.org/wiki/AI_safety" rel="nofollow">https://en.wikipedia.org/wiki/AI_safety he only gets one mention in the odd links box at the bottom of the page. I don't really get in but I don't do sex cults so maybe it's that?
delichon · 1789835777 · focus · HN ↗
> There has been a great effort over many years to distance AI Safety discussion and policy from its origins and intellectual center, because its center is a sex cult started by a fan fiction author. If you want to be taken seriously you have to hide that.
This may be true, but it means that those readers are using irrelevant ad hominem to allocate respect, meaning that the flaw is in them rather than the author.
1. ozozozd · 1789837671 · focus · HN ↗
  Would a formal scientific and/or engineering education be an indicator? (Or lack thereof as is the case here)
  Happy to fast-forward a bit: I will not take “sat and thought deeply” as a qualification, which would make all other prophets qualified for scientific/engineering judgement.
  1. delichon · 1789837905 · focus · HN ↗
    > Would a formal scientific and/or engineering education be an indicator?
    It's certainly a lot more relevant than their sex or fiction writing preferences.
tzs · 1789852044 · focus · HN ↗
This seemed like it might have a point in there somewhere but it was hard to be sure when it was posted two days ago via a site that turns social media sequences of posts into more normal looking articles [1].
The original social media form does not improve the situation.
[1] <a href="https://news.ycombinator.com/item?id=49737985">https://news.ycombinator.com/item?id=49737985
1. dang · 1790274596 · focus · HN ↗
  Comments belatedly moved thither. Thanks!
1vuio0pswjnm7 · 1789858948 · focus · HN ↗
1785992697 | I Went to a 'Torture Party' with Polyamorous Bay Area Rationalists | <a href="https://archive.ph/CdYKX" rel="nofollow">https://archive.ph/CdYKX | <a href="https://news.ycombinator.com/item?id=49192673">https://news.ycombinator.com/item?id=49192673 | 0 comments
1789634197 | AI safety is mostly a sex cult | <a href="https://skywriter.blue/@segyges.bsky.social/3mvom4b4dn22q" rel="nofollow">https://skywriter.blue/@segyges.bsky.social/3mvom4b4dn22q | <a href="https://news.ycombinator.com/item?id=49737985">https://news.ycombinator.com/item?id=49737985 | 284 comments
1789641808 | Music subreddit exposes Yudkowsky and the "AI safety" sex cult before SE Gyges | <a href="https://www.reddit.com/r/grimezs/comments/1tuzmpo/grimes_miri_and_the_rationalistaesthetic_complex/" rel="nofollow">https://www.reddit.com/r/grimezs/comments/1tuzmpo/grimes_mir... | <a href="https://news.ycombinator.com/item?id=49738867">https://news.ycombinator.com/item?id=49738867 | 0 comments
1789642158 | Grimes, Aella, and the Bay Area "AI safety" sex cult | <a href="https://www.reddit.com/r/grimezs/comments/1tuzmpo/grimes_miri_and_the_rationalistaesthetic_complex/" rel="nofollow">https://www.reddit.com/r/grimezs/comments/1tuzmpo/grimes_mir... | <a href="https://news.ycombinator.com/item?id=49738929">https://news.ycombinator.com/item?id=49738929 | 0 comments
1789742785 | Cult of Anthropic Insiders Rumored to Be Worshipping Claude as a God | <a href="https://futurism.com/future-society/cult-anthropic-insiders-worshipping-claude-god" rel="nofollow">https://futurism.com/future-society/cult-anthropic-insiders-... | <a href="https://news.ycombinator.com/item?id=49755168">https://news.ycombinator.com/item?id=49755168 | 0 comments
1789829846 | The Doomsday Cult Inside OpenAI Patrick Boyle [video] | <a href="https://www.youtube.com/watch?v=luXnftoxCaM" rel="nofollow">https://www.youtube.com/watch?v=luXnftoxCaM | <a href="https://news.ycombinator.com/item?id=49767080">https://news.ycombinator.com/item?id=49767080 | 0 comments
1. piloto_ciego · 1789859348 · focus · HN ↗
  Interesting how little interaction there is with these....
  1. api · 1789859694 · focus · HN ↗
    Try bringing up Scientology in Hollywood.
    I think you can now but there was a time when saying anything bad about that cult would get you blackballed from the industry. It’s still powerful.
sleight42 · 1789881086 · focus · HN ↗
JFC this was clickbait. Even if this wasn't the intent and even if the dude has atypical sexual practices, if it's between consenting adults then how is it anyone else's business?

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.