Why is uncertainty about the motives of one form of superintelligence terrifying, whilst, at the same time, uncertainty about the motives of another, omnipotent supernatural intelligence comforting? i.e. the “I don’t know God’s plan, but I sleep well knowing He has one” line of reasoning.
God’s been around for thousands of years and we are still here and flourishing, so obviously God is in some way “aligned”; the same cannot be said for AGI.
edit: Guys, I said “in some way”, not “perfectly”.
Survivorship bias. Ask all the humans that have died in horrific screaming agony, and saw everything they worked for turned to dust how well that was aligned with their interests.
injidup · · focus · HN ↗
fwlr · · focus · HN ↗
edit: Guys, I said “in some way”, not “perfectly”.
simonh · · focus · HN ↗
tylerlaprade · · focus · HN ↗