I'm not sure this is even conceivable, but... Imagine the bootstrap problem of intelligence systems going down, when no one knows how to bring them back up without the system itself walking them through it... Like if power and intelligence were to go down in a Carrington-class event in 10 years...
Like what would happen to individuals ten years from now who are trying to live if AI suddenly became inaccessible
Of course we all know most humans are useless and unable to survive outside our culture, but the difference is that I'm trying to picture is the individual trying the reason through challenges. The version of this that has been obvious to me up to now is that the individual didn't have the knowledge to look after themselves. But I guess it feels different to conceive of them not having the ability to fully reason on their own...?
To not just lack the objects of intelligence, but the very process of it...
It's a real problem but your framing of it is itself very alarming.
Most humans aren't useless by any measure of most or usefulness. Our culture is our tools, dying due to a lack of antibiotics doesn't mean you didn't have anything to contribute, it means you didn't have access to the tool you needed. This is the problem we need to guard against.
No one is going to lose the ability to reason! This is accepting the most extreme version of the marketing presented by frontier labs, don't do it. People may lose fluency or familiarity or access to training on specific skills. We should put some care into making sure that can't be a catastrophe, for sure.
You've obviously never stood in a room of college freshmen and tried to deal with a young man having repeated issues being able to type his _own_ name into a box on a screen.
patcon · · focus · HN ↗
Like what would happen to individuals ten years from now who are trying to live if AI suddenly became inaccessible
Of course we all know most humans are useless and unable to survive outside our culture, but the difference is that I'm trying to picture is the individual trying the reason through challenges. The version of this that has been obvious to me up to now is that the individual didn't have the knowledge to look after themselves. But I guess it feels different to conceive of them not having the ability to fully reason on their own...?
To not just lack the objects of intelligence, but the very process of it...
dcss_gardener · · focus · HN ↗
Most humans aren't useless by any measure of most or usefulness. Our culture is our tools, dying due to a lack of antibiotics doesn't mean you didn't have anything to contribute, it means you didn't have access to the tool you needed. This is the problem we need to guard against.
No one is going to lose the ability to reason! This is accepting the most extreme version of the marketing presented by frontier labs, don't do it. People may lose fluency or familiarity or access to training on specific skills. We should put some care into making sure that can't be a catastrophe, for sure.
Vrondi · · focus · HN ↗
Hugsbox · · focus · HN ↗