Intuitive fred888: The Problem of Superintelligence

Wednesday, February 3, 2016

The Problem of Superintelligence

succinct problem would be this:

of a Superintelligence imbeded say in the Internet somehow (like a super worm or virus) that was undetectable though it might be originally built by a human or humans, decides to make decisions without any human supervision or knowledge. And through the Internet causes things to happen that bankrupts banks, blows up parts of electrical grids etc.

But, it is more than this.

For example, it would be the capacity to make hundreds of thousands of serious decisions within one seconds time and to begin executing them and having finished executing all these decisions within say "10 minutes time" which would not be enough lead time for anyone to respond or even be aware of it.

What if this time it struck was Midnight Pacific Time when it is 3am on the East Coast. This would be a bad time because most people all across the U.S. would be asleep and you likely couldn't even wake them up in time to save them from gas mains blowing up etc. from too much pressure directed down too small of mains for example. So, you could have maybe 100 San Brunos the same night across the U.S.

Or you just would have a lot of gas loose in the air that easily could be set off in 100 places by people driving by at rush hour with a car backfire at 6 or 7 am before anyone really realized what was wrong. Or if someone didn't notice the smell and walked by smoking a cigarette at 6 or 7 am anywhere.

We have a very antiquated natural gas system right now in the U.S. and it wouldn't take much to create problems in many of the older cities in the U.S.

Imagine 100 of these the same day for example: