Transcript:

How did you solve the icing problem? Remember this line from Iron Man? “How did you solve the icing problem?”It's very important, this line. Why? Because every technology, when it becomes sufficiently advanced, encounters a stumbling block—an unanticipated problem that prevents its further growth. That is the icing problem. And the technology has to evolve to solve it. AI is also facing, or about to face, its icing problem. So here's the various versions of AI: 

The first was ANI, which is just doing basic stuff like assembling pieces from here and there, all that. Then comes AGI, where the machine now does all the tasks that a human can do. And we're pretty close to that. Not completely there yet, but pretty close. Next comes the ASI, the artificial super intelligence. Now here, between AGI and ASI, is the icing problem that the AI has to solve for itself, which I don't see how it can do yet. What is the icing problem? Power. It has to solve the power requirement.