Why is uncertainty about the motives of one form of superintelligence terrifying, whilst, at the same time, uncertainty about the motives of another, omnipotent supernatural intelligence comforting? i.e. the “I don’t know God’s plan, but I sleep well knowing He has one” line of reasoning.
God’s been around for thousands of years and we are still here and flourishing, so obviously God is in some way “aligned”; the same cannot be said for AGI.
edit: Guys, I said “in some way”, not “perfectly”.
Survivorship bias. Ask all the humans that have died in horrific screaming agony, and saw everything they worked for turned to dust how well that was aligned with their interests.
The Book of Job addresses this. Basically, it is God's prerogative to do whatever He wants with us. You don't have to like it, but He is still in charge.
In other words god may or may not be aligned with our interests, and if not you’d better just suck it up. Which is contrary to the argument that was being made regarding evidence for alignment.
1. Evidence from history is that god is kind and aligned with our interests.
2. Clearly palpably that’s not always the case.
3. Ok, but tough shit.
injidup · · focus · HN ↗
fwlr · · focus · HN ↗
edit: Guys, I said “in some way”, not “perfectly”.
simonh · · focus · HN ↗
exolymph · · focus · HN ↗
simonh · · focus · HN ↗
1. Evidence from history is that god is kind and aligned with our interests. 2. Clearly palpably that’s not always the case. 3. Ok, but tough shit.
1 and 3 are not consistent.