"Artificial Intelligence/robots/Omohundro: Problem: intelligent entities must act to preserve their own existence. This tendency has nothing to do with a self-preservation instinct or any other biological notion; it’s just that an entity cannot achieve its objectives if it’s dead. According to Omohundro’s argument, a superintelligent machine that has an off switch - which some, including Alan Turing himself, in a 1951 talk on BBC Radio 3, have seen as our potential salvation - will take steps to disable the switch in some way.Thus we may face the prospect of superintelligent machines - their actions by definition unpredictable by us and their imperfectly specified objectives conflicting with our own - whose motivations to preserve their existence in order to achieve those objectives may be insuperable."
This argument does not need superintelligent machines, it reflects the reality of each one of us in this world. No animal nor human is ready to die (to change the switch on "OFF") and it will strive to keep going. AI is frightening, but no more than an unknown stranger.
No comments:
Post a Comment