An Oral History of the Scaling Era

An inside view of the AI revolution, from the people and companies making it happen. How did we build large language models? How do they think, if they think? Will we be able to make them share our goalsand what happens if we cant? In a series of in-depth interviews with leading AI researchers and company foundersincluding Anthropic CEO Dario Amodei, DeepMind cofounder Demis Hassabis, OpenAI cofounder Ilya Sutskever, MIRI cofounder Eliezer Yudkowsky, and Meta CEO Mark ZuckerbergDwarkesh Patel provides the first comprehensive and contemporary portrait of the technology that is transforming our world. Drawn from his interviews on the Dwarkesh Podcast, these curated excerpts range from the technical details of how LLMs work to the economic, philosophical, and safety considerations of creating artificial general intelligenceAI that can do anything humans can, and more. Patels conversations cut through the noise and the hype to explore the topics compelling those at the forefront of the field: the power of scaling, the nature of training, the potential for misalignment, the inputs required to achieve AGI, and the economic and social ramifications of superintelligence. At a time of great promise and great uncertainty, An Oral History of the Scaling Era offers readers unprecedented insight into a transformative moment in the AIs developmentand a revealing vision of what comes next.