Nice essay but the core point of AGI is that it will universally disempower humans in all domains, send the value of human labor to 0, and construct a world far beyond human comprehension that will be disorienting and horrifying.
Meh, that's debatable. I don't think the problems we have require much in the way of intelligence to solve, we don't have them because we aren't smart enough. I feel aligned AGI or ASI would get crushed by the reality of humanity and the sheer strength of its inertia, just the same way aligned smart humans get crushed by it.
Intelligence isn't magic. It can only overcome so much brute force and humanity, as a non-intelligent system made out of intelligent parts, carries an ungodly amount of brute force.
atleastoptimal · · focus · HN ↗
vanuatu · · focus · HN ↗
breuleux · · focus · HN ↗
Intelligence isn't magic. It can only overcome so much brute force and humanity, as a non-intelligent system made out of intelligent parts, carries an ungodly amount of brute force.