AMD has countered NVIDIA’s recent assertion that its H100 compute accelerators, equipped with optimized TensorRT-LLM libraries for AI computing, outperform AMD’s new Instinct MI300X accelerators. AMD maintains that its accelerators remain superior.
NVIDIA’s Test Results and AMD’s Rebuttal
A couple of days ago, NVIDIA released its test results for the specialized Hopper H100 computing accelerators. They claimed these were significantly faster than AMD’s latest MI300X AI accelerators, unveiled at the recent Advancing AI event. NVIDIA argued that AMD did not utilize the specially optimized TensorRT-LLM software libraries for the H100 in their comparison, which enhance the efficiency of NVIDIA’s AI chips.
NVIDIA’s tests, conducted using the TensorRT-LLM libraries, demonstrated an almost 50% advantage over the AMD MI300X accelerators. In response, AMD presented new graphs showing that the MI300X still outpaces the H100 accelerators, even when the latter utilize a software stack optimized for them.
AMD’s Counter-Arguments
AMD argues that NVIDIA’s data is based on H100 tests with TensorRT-LLM libraries, as opposed to the vLLM libraries used for AMD accelerator tests. They also point out that NVIDIA compares the performance of AMD Instinct MI300X accelerators using FP16 calculations, while employing FP8 data for testing its H100.
AMD’s New Test Results
According to AMD’s new tests, its MI300X accelerators, running vLLM libraries, are 30% more efficient than NVIDIA’s H100 accelerators, even when the latter operate TensorRT-LLM libraries.
AMD’s Official Statement
In their official statement, AMD clarified that their MI300X solution was reported to be 1.4 times faster than the H100 under equivalent data types and calculation software during their announcement in early December. With their latest optimizations, the MI300X performs 2.1 times faster than its competitor.
The Ongoing Competition in AI Computing
This public dispute between AMD and NVIDIA underscores the intense competition in the AI computing segment, with hardware manufacturers ready to vie for every customer.