The podcast addresses the emerging crisis in AI: a shortage of memory chips. It highlights how the demand for memory, particularly high bandwidth memory (HBM), is skyrocketing due to AI's rapid growth, causing prices of graphics cards and RAM to surge. The discussion points out that memory constitutes 80% of a GPU's material cost, impacting consumer electronics beyond just AI-specific hardware. As examples, the hosts note the increasing RAM prices, and the potential cost increase of Apple's A20 chip. The conversation further identifies Samsung, SK Hynix, and Micron as key memory manufacturers, noting their significant stock increases and control over supply. It also touches on NVIDIA's acquisition of Grok as a strategic move to mitigate DRAM price hikes.
Sign in to continue reading, translating and more.
Continue