Benchmark results disclosed by Intel suggest that you Gaudi 2 accelerators It also has superior capabilities as an NVIDIA GPU with artificial intelligence. According to tests carried out by Stability AI, on the Gaudi 2 forum 55% faster than NVIDIA H100 and it is very fast like the A100 in synthetic AI benchmarks.
This comparison appears to be considering NVIDIA's solutions currently available on the market, and the Blackwell architecture accelerators will be demonstrated next week during GTC 2024. Intel is also developing the Gaudi 3 accelerators to compete with the next generation of NVIDIA GPUs for AI.
The testes involve the Stable Diffusion 3 model, used for generating text for the image. Gaudi 2 got 927fps, while the NVIDIA H100 achieved 595fps and the A100 cost 381fps.
While NVIDIA GPUs largely dominate today's AI infrastructure, particularly in model-based services like GPT, Intel is rapidly optimizing or leveraging its accelerators to establish a competitive offering in the market .
Intel's goal is not to force companies that use AI accelerators to migrate to Gaudi, but they are offering a competitive alternative. This allows us to secure contracts with customers who have not adopted AI platforms, as well as opportunities for infrastructure refreshes and expansions.
It is important to note that as GPUs are most efficient in training natural language models, while inference executions are usually handled by CPUs.