COMPARE.

NVIDIA

NVIDIA H200 SXM 141 GB

GPU^*

Video memory

141 GB^*

Rated memory bandwidth

4,890 GB/s^*

Thermal design power

700 W^*

GPU cores

16,896^*

LLM Inference: MLPerf: gptj-99.9 (fp8) · version unreported · score#1^* · 2,562.73^* tokens/sPlatform unreported

No Blender rendering score

NVIDIA

NVIDIA H100 SXM5 80 GB

GPU^*

Video memory

80 GB^*

Rated memory bandwidth

3,360 GB/s^*

Thermal design power

700 W^*

GPU cores

16,896^*

LLM Inference: MLPerf: gptj-99.9 (fp8) · version unreported · score#2^* · 2,414.86^* tokens/sPlatform unreported

No Blender rendering score

NVIDIA

NVIDIA H100 SXM5 94 GB

GPU^*

Video memory

94 GB^*

Rated memory bandwidth

3,360 GB/s^*

Thermal design power

700 W^*

GPU cores

16,896^*

LLM Inference: MLPerf: gptj-99.9 (fp8) · version unreported · score#3^* · 1,693.47^* tokens/sPlatform unreported

No Blender rendering score

NVIDIA

NVIDIA H100 PCIe 80 GB

GPU^*

Video memory

80 GB^*

Rated memory bandwidth

2,040 GB/s^*

Thermal design power

350 W^*

GPU cores

14,592^*

LLM Inference: MLPerf: gptj-99.9 (fp8) · version unreported · score#4^* · 1,562.82^* tokens/sPlatform unreported

No Blender rendering score