01/04/2024

The history of Earth up until now has been a history of optimizers spinning their wheels at a constant rate, generating a constant optimization pressure. And creating optimized products, not at a constant rate, but at an accelerating rate, because of how object-level innovations open up the pathway to other object-level innovations. But that acceleration is taking place with a protected meta level doing the actual optimizing.

— Robin Hanson, Eliezer Yudkowsky, The Hanson-Yudkowsky AI-Foom Debate