Why True AI is a bad idea
Let’s assume we use it to augment ourselves.
The central problem with giving yourself an intelligence explosion is the more you change, the more it stays the same. In a chaotic universe, the average result is the most likely; and we’ve probably already got that.
The actual experience of being a billion times smarter is so different none of our concepts of good and bad apply, or can apply. You have a fundamentally different perception of reality, and no way of knowing if it’s a good one.
To an outside observer, you may as well be trying to become a patch of air for all the obvious good it will do.
So a personal intelligence explosion is off the table.
As for the weightlessness of a life besides a god; please try playing AI dungeon (free). See how long you can actually hack a situation with no limits and no repercussions and then tell me what you have to say about it.