INSIDE a 1.44TB HBM3e NVIDIA HGX B200 AI Server from ASRock Rack

The ASRock Rack 8U8X GNR2 SYN B200 represents a high-end AI training and inference server, featuring eight NVIDIA Blackwell B200 GPUs and dual Intel Xeon 6 processors. This 8U system integrates 1.4 terabytes of HBM3E memory and ten NVIDIA ConnectX-7 400GbE NICs, providing four terabits per second of total network bandwidth. Key design innovations include a modular PCIe switchboard for efficient lane management, flexible front-to-rear IO cabling options, and a highly serviceable HGX platform tray. While the system utilizes twelve 3kW power supplies for redundancy, actual power consumption typically ranges between 12 and 14 kilowatts. The architecture emphasizes high-throughput connectivity and ease of maintenance, addressing the critical need for rapid data movement in large-scale AI clusters to prevent GPU stalling during intensive training workloads.