Product details

product description 

H100 NVL single card has up to 94GB HBM3 high bandwidth video memory (memory), 

according to this capacity is obviously opened the full 6144-bit bit width, and enabled all 

six, the equivalent frequency according to 5.1GHz calculation, the bandwidth is the terrible 3.9TB/s.

But there is also a problem, the total capacity of six HBM3 video memory should be 96GB, 

but there is 2GB less, there is no official explanation, guess or for good yield consideration, 

shielded a few storage units.

In contrast, the H100 PCIe/SXM version only has 5120-bit bit width enabled, uses only five 

of the six video bits, and has a capacity of 80GB, the difference being that one is 2TB/s 

bandwidth for HBM2e and one is 3.35TB/s bandwidth for HBM3.