INSIDE a 1.44TB HBM3e NVIDIA HGX B200 AI Server from ASRock Rack

The ASRock Rack 8U8X GNR2 SYN B200 represents a high-performance AI training and inference server built around the NVIDIA HGX B200 platform. This 8U system integrates eight Blackwell GPUs, providing over 1.4 terabytes of HBM3E memory, alongside dual Intel Xeon 6 processors and eight 400GbE ConnectX-7 network interface cards. A unique modular design features a PCIe switchboard that optimizes data throughput and simplifies maintenance, while the chassis allows for flexible front or rear I/O configurations. Operating at an estimated 12 to 14 kilowatts, the server delivers significant performance gains over the previous Hopper generation, specifically through enhanced FP4 support and faster NVLink interconnects. The architecture prioritizes scalability and serviceability, ensuring that high-density GPU clusters maintain consistent data flow without bottlenecks during intensive AI workloads.