Andrej Karpathy — AGI is still a decade away

In this interview, Andrej Karpathy discusses his perspective on the progress and future of AI agents, suggesting a more realistic timeline of a decade rather than a single year for significant advancements. He reflects on the history of AI, highlighting key breakthroughs and missteps, and contrasts animal and machine learning approaches. Karpathy also touches on the limitations of current LLMs, particularly in coding and knowledge retention, and explores the potential for continual learning and the development of a "cognitive core." The conversation further delves into the challenges of reinforcement learning, the importance of synthetic data generation, and the potential for AI to transform education, culminating in a discussion on the nature of superintelligence and its impact on society.