Can Intel Gaudi 3 Help Its Comeback Efforts?
At Vision 2024, $Intel(INTC)$ unveiled a comprehensive AI strategy for enterprises, with open, scalable systems that work across all AI segments.
This new enterprise AI would be deemed to be open and more secure, Intel is wooing new customers, partners and collaborations across the AI space.
Fraction Of A Cost Than Nvidia H100
Intel Gaudi 3 AI accelerator deliver 50% on average better inference and 40% average better power efficiency than Nvidia H100, and this is only a fraction of the cost of H100.
Intel also announced the Gaudi 3 availability to original equipment manufacturers (OEMs), the OEMs include names like Dell Technologies, Hewlett Packard Enterprise, Lenovo and Supermicro, with this new offerings, we could see broadening the AI data center market offerings for enterprises.
But I think what I as an investor would be interested is whether this new AI accelerator could bring interest and sentiment back for Intel, how would this help Intel to come back to the AI race?
In this article, I will try to look at how market perceive this new AI accelerator, how Intel would plan to sell this?
Intel Can Sell AI Accelerators To Pytorch Masses
First we need to understand that matrix math engine runs the PyTorch framework and the Llama larger language model, these two are open source, both also come from $Meta Platforms, Inc.(META)$. These have been widely adopted by enterprises. So now we heard that Intel has unveiled its third generation Gaudi AI accelerators at its Vision 2024 event in Phoenix.
The next questions would be how many Gaudi 3 accelerators can Intel make? How much would it cost? What can the product being shipped?
Intel which is working with $Taiwan Semiconductor Manufacturing(TSM)$ to etch and package the Gaudi 3 accelerators. We will need to look at how TSM would prioritise this production.
Gaudi 1 accelerator was launched back in July 2019 by Habana Labs which was acquired by Intel in December 2019 for $2 billion. Gaudi 1 was to compete with Nvidia’s “Volta” V100 then in a ridiculously smaller AI space.
This time, it will be different, as Intel need to be more aggressive in making and selling Gaudi 3 chips than it has been with either Gaudi 1 or Gaudi 2. We might also need to expect that Intel Gaudi would significantly be behind Nvidia when it comes to raw accelerator performance.
Intel need to seize the opportunity to sell aggressive and attract the PyTorch crowd, with Llama LLMs and a seemingly zillion other AI models available on Hugging Face. So the partnership formed up would be important.
Cost Of Gaudi 3 Likely To Follow Nvidia H100 Proportional
As some of us might already know, it is simple to find out the cost of Gaudi 3 accelerators, it will be directly proportional to the performance of the Nvidia “Hopper” H100 GPU accelerator that it completes against and the street price that Hopper H100 GPUs have with 96 GB of HBM3 memory capacity and 3.9 TB/sec of bandwidth.
As the Hopper H200 variants, which have 141 GB of HBM3e memory capacity and 4.8 TB/sec of bandwidth, start shipping in a few months, the math will shift to a comparison with the H200s.
We could see Intel adjusting the price of Gaudi 3 accordingly when $NVIDIA Corp(NVDA)$ start to ship its future “Blackwell” B100 and B200 GPU accelerators later this year and into 2025.
Industry Backing For Gaudi 3
Gaudi also comes with some big-name backing, including this statement from stability.ai: “Alternatives like Intel Gaudi accelerators give us better price performance, reduced lead time and ease of use with our models taking less than a day to port over.”
With software already available on the Intel Developer Cloud, it promises developers that they can build their software for Gaudi 2 today and then “migrate it seamlessly” to Gaudi 3 on its release.
Will Third Time Be The Charm?
Actually the timing for the Gaudi 3 accelerator launch would be better for Intel to be in the spring of 2022 alongside with Nvidia Hopper GPU, this is because two years gap later, we could already see the demand or Nvidia GPUs is so strong that there is never a better time to sell a technology that should already be two years old.
Intel would need to sell all of Gaudi 3 and Falcon Shores that it can make in the short term. Any further delays in the production could cost more damage as Nvidia will ramps mightily and AMD starts getting traction, too, with its “Antares” Instinct MI300 series of GPU accelerators.
The Gaudi 3 accelerator is an big evolutionary jump from the Gaudi 2. But the big architectural change is coming with Falcon Shores, but one that will largely be insulated from customers using PyTorch and higher models upon that framework.
It would have been good for Habana Labs and then Intel if Meta Platforms had chosen the Gaudi accelerators as its AI engines, but clearly that did not happen and Meta Platforms is creating its own line of MTIA accelerators for AI training and inference and in the interim is buying hundreds of thousands of Nvidia GPUs.
So Is Intel Still A Potential Trade?
With potential risk of missing out of sales to pytorch masses, which many would have already start building their models on Nvidia GPUs, even Meta is creating its own line of MTIA accelerators for AI training and inference and buying thousands of GPUs from Nvidia.
So the market share that Intel is trying to capture with missed timing of launch could cost them dearly. As seen from the technical analysis below, Intel is trying to come out from pullback, but it did not manage to, the best is only to stay sideway.
MACD is showing a downward trend, meaning that traders and investors are not taking much interest despite the new launch, as seen from the selling sentiment, it has been on the high side as well.
I personally think that we should look at how orders would start to form the demand for Intel new Gaudi 3, before we make any move.
Summary
Intel is facing an uphill task of trying to capture the hot AI accelerator market, with a two year gap launch than Nvidia, to catch up with the demand that Nvidia has build, is quite hard, though not impossible.
The next few weeks and months before Nvidia “Blackwell” B100 and B200 GPU accelerators start shipping later this year, how much can Intel gather in terms of demand would be important for its stock price?
I would watch out for any news of order for Intel Gaudi 3, then we shall discuss again on how Intel could fulfill the orders, that is a different discussion again.
Appreciate if you could share your thoughts in the comment section whether you think Intel could make a comeback with Gaudi 3 accelerator?
@TigerStars @Daily_Discussion @Tiger_Earnings @TigerWire appreciate if you could feature this article so that fellow tiger would benefit from my investing and trading thoughts.
Disclaimer: The analysis and result presented does not recommend or suggest any investing in the said stock. This is purely for Analysis.
Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.
The main reason being that intel simply is not the leader in any of their core businesses with better products from competitors. It is playing a painful catch up game being hampered fundamentally by them agging behind for years in process nodes and technology.
Their cpu have good performance but draw more power, their gpu is sound but was lagging behind due to drivers , the foundry initiative is not doing well and tough to compete against TSMC and other already established foundries especially given their lower process node making it a no go for high value HPC chips. Intel having to fab Gaudi3 chips and competing in orders with Nvidia, amd and apple summarizes the whole dilemma.
Intels only hope now is to make good on their advanced process node and being first in backside power delivery making chips smaller and more power efficient.
No no no such a terrible one as a stock!!!