22 Jan 2024
10m

Beyond Google: Transformer Paper Author's Nature-Inspired AI Venture, Sakana

Podcast cover

Strict Scrutiny

Sakana AI, a Tokyo-based startup founded by former Google researchers Leon Jones and David Ha, aims to revolutionize foundational AI by implementing nature-inspired, modular architectures. Rather than relying on massive, monolithic models, the company utilizes a "school of fish" approach where numerous interconnected micro-models synchronize to perform complex tasks. This decentralized structure offers significant advantages, including reduced computational costs, improved efficiency, and enhanced legal flexibility, as individual models can be retrained or replaced without overhauling the entire system. By establishing operations in Tokyo, the founders seek to diversify the global AI ecosystem, moving beyond the homogeneous perspectives often found in Silicon Valley. This shift toward leaner, adaptable AI systems challenges the current industry reliance on resource-intensive, centralized models, potentially setting a new standard for sustainable and scalable artificial intelligence development.

Outlines

Sign in to continue reading, translating and more.

Open full episode in Podwise