βSelf-preservation canβt be a subgoal; it has to be the core goal. Suddenly, the irony of the AI horror stories was becoming clear. The companies tell us these stories because they assume it makes their technology look more powerful. But if an AI actually did have autonomy, it would be far less powerful.β