
The podcast explores the performance differences among several AI supercomputers featuring the Grace Blackwell chip, including the DGX Spark, ASUS GX10, Dell GB10, and MSI Edge Expert. It addresses claims of thermal throttling in the DGX Spark, referencing John Carmack's observations, and presents test results using small and large language models to evaluate power draw, temperature, and clock speeds. While the machines showed similar performance in standard LLM tasks, differences emerged under a GPU burn test, with the ASUS GX10 experiencing thermal slowdown. The podcast also highlights the advantage of the DGX Spark's Gen 5 NVMe drive in cold start scenarios due to faster model loading times compared to the Gen 4 drives in other machines.
Sign in to continue reading, translating and more.
Continue