In complex enviroment, better inteligence gives you better chance to survive. But complexity of every real-world environment is finite. Assume that more inteligence need more computing power, more resources. Then one day self improving inteligence gets to the level when it can handle complexity of its environment optimally and improving itself will only consumes more resource but not gives additional advantage in that environment. Then artificial inteligence (because is inteligent) will stop self improvement and freezes its own inteligence at optimal level of inteligence for environment it lives in. And maybe in our environment, artificial inteligence can reach optimal state even before it overcomme human inteligence and then singularity will never happen. What do you think?
closed as off-topic by user2953, James Kingsbery, virmaior Jul 28 '15 at 4:52
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "Questions that push a personal philosophy with no question beyond "am I right" or "what do you think" are off-topic here as this is not a blog. It's ok to express unique opinions, but you must have an actual, answerable question to go with them." – Community, James Kingsbery, virmaior
Its optimal intelligence is limited only assuming the environment is finite in all aspects and that it has no goals other than to react to its environment as appropriately as possible. However, this is not true when you consider time in our universe. Chaos theory roughly says that disorder increases over time and small differences in the initial states in two systems build over time. This implies that there may not be a maximum intelligence due to it thinking about the increasingly more long-term effects of the current state of the system. The assumption also isn't true if it has creative desires. Creative desires would cause it to start imagining/thinking about its own theoretical universes and "things" once it gets bored with the environment it exists in and it feels there is nothing more to be gained from the environment it lives in.
The universe itself is limited, which means the possibilities of an artificial intelligence are limited. I think your question is "assuming an artificial intelligence would have a reasonable means to try to improve itself, would there be a point where improvement is either not possible, or where the AI would have good reasons to stop improving?"
An autonomous AI, even if it wasn't highly intelligent, could improve itself by buying better or more hardware. There might be limits how much improvement is possible that way. For example if the AI needs to use its intelligence to make money to pay the electricity bill and can only use what remains to improve itself, there might be a point where it grows to a size where the electricity bill gets too high.
Improving itself by improving its code is hard. Only a highly intelligent and well trained human could do this, so it would require a highly intelligent AI as well to do this. Much more intelligent than the average human. Again, improving say the intelligence of an AI that has an IQ of 180 might be so difficult that an AI with an IQ of 180 cannot do it. We don't know.
And then there might be a point where an AI has reasons not to improve itself. For example, if there is legislation that all AIs above a certain complexity will be destroyed out of fear, then the AI won't want to be covered by that legislation. Maybe if it increases its hardware, delays between components might increase and the AI might feel that as unpleasant. Or maybe improving itself might be hard work, and the AI might be too lazy.