Nvidia Q2 Preview: Blackwell And Liquid Cooling Could Form Killer Combination

seekingalpha08-21

Nvidia's key partner, Super Micro Computer, recently reported the delivery of direct liquid cooling (DLC) systems for NVDA chips.NVDA’s Blackwell AI chips, when combined with DLC, could fundamentally ...

Source Link

Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.

Comments

We need your insight to fill this gap

Leave a comment

{"i18n":{"language":"en_US"},"isChannel":false,"data":{"share":"https://ttm.financial/m/news/2461814047?lang=en_US&edition=fundamental","thumbnail":"https://static.seekingalpha.com/cdn/s3/uploads/getty_images/1141488976/image_1141488976.jpg","is_english":true,"pubTime":"2024-08-21 16:43","share_image_url":"https://static.laohu8.com/5a36db9d73b4222bc376d24ccc48c8a4","id":"2461814047","market":"sh","top_or_hot":-1,"title":"Nvidia Q2 Preview: Blackwell And Liquid Cooling Could Form Killer Combination","media":"seekingalpha","content":"<div>\n<p>Nvidia's key partner, Super Micro Computer, recently reported the delivery of direct liquid cooling (DLC) systems for NVDA chips.NVDA’s Blackwell AI chips, when combined with DLC, could fundamentally ...</p>\n\n<a href=\"https://seekingalpha.com/article/4716104-nvidia-stock-q2-preview-blackwell-and-liquid-cooling-could-form-killer-combination\">Source Link</a>\n\n</div>\n","source":"seekingalpha","html":"<!DOCTYPE html>\n<html>\n<head>\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=utf-8\" />\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1.0,minimum-scale=1.0,maximum-scale=1.0,user-scalable=no\"/>\n<meta name=\"format-detection\" content=\"telephone=no,email=no,address=no\" />\n<title>Nvidia Q2 Preview: Blackwell And Liquid Cooling Could Form Killer Combination</title>\n<style type=\"text/css\">\na,abbr,acronym,address,applet,article,aside,audio,b,big,blockquote,body,canvas,caption,center,cite,code,dd,del,details,dfn,div,dl,dt,\nem,embed,fieldset,figcaption,figure,footer,form,h1,h2,h3,h4,h5,h6,header,hgroup,html,i,iframe,img,ins,kbd,label,legend,li,mark,menu,nav,\nobject,ol,output,p,pre,q,ruby,s,samp,section,small,span,strike,strong,sub,summary,sup,table,tbody,td,tfoot,th,thead,time,tr,tt,u,ul,var,video{ font:inherit;margin:0;padding:0;vertical-align:baseline;border:0 }\nbody{ font-size:16px; line-height:1.5; color:#999; background:transparent; }\n.wrapper{ overflow:hidden;word-break:break-all;padding:10px; }\nh1,h2{ font-weight:normal; line-height:1.35; margin-bottom:.6em; }\nh3,h4,h5,h6{ line-height:1.35; margin-bottom:1em; }\nh1{ font-size:24px; }\nh2{ font-size:20px; }\nh3{ font-size:18px; }\nh4{ font-size:16px; }\nh5{ font-size:14px; }\nh6{ font-size:12px; }\np,ul,ol,blockquote,dl,table{ margin:1.2em 0; }\nul,ol{ margin-left:2em; }\nul{ list-style:disc; }\nol{ list-style:decimal; }\nli,li p{ margin:10px 0;}\nimg{ max-width:100%;display:block;margin:0 auto 1em; }\nblockquote{ color:#B5B2B1; border-left:3px solid #aaa; padding:1em; }\nstrong,b{font-weight:bold;}\nem,i{font-style:italic;}\ntable{ width:100%;border-collapse:collapse;border-spacing:1px;margin:1em 0;font-size:.9em; }\nth,td{ padding:5px;text-align:left;border:1px solid #aaa; }\nth{ font-weight:bold;background:#5d5d5d; }\n.symbol-link{font-weight:bold;}\n/* header{ border-bottom:1px solid #494756; } */\n.title{ margin:0 0 8px;line-height:1.3;color:#ddd; }\n.meta {color:#5e5c6d;font-size:13px;margin:0 0 .5em; }\na{text-decoration:none; color:#2a4b87;}\n.meta .head { display: inline-block; overflow: hidden}\n.head .h-thumb { width: 30px; height: 30px; margin: 0; padding: 0; border-radius: 50%; float: left;}\n.head .h-content { margin: 0; padding: 0 0 0 9px; float: left;}\n.head .h-name {font-size: 13px; color: #eee; margin: 0;}\n.head .h-time {font-size: 11px; color: #7E829C; margin: 0;line-height: 11px;}\n.small {font-size: 12.5px; display: inline-block; transform: scale(0.9); -webkit-transform: scale(0.9); transform-origin: left; -webkit-transform-origin: left;}\n.smaller {font-size: 12.5px; display: inline-block; transform: scale(0.8); -webkit-transform: scale(0.8); transform-origin: left; -webkit-transform-origin: left;}\n.bt-text {font-size: 12px;margin: 1.5em 0 0 0}\n.bt-text p {margin: 0}\n</style>\n</head>\n<body>\n<div class=\"wrapper\">\n<header>\n<h2 class=\"title\">\nNvidia Q2 Preview: Blackwell And Liquid Cooling Could Form Killer Combination\n</h2>\n\n<h4 class=\"meta\">\n\n\n2024-08-21 16:43 GMT+8&nbsp;&nbsp;&nbsp;<a href=https://seekingalpha.com/article/4716104-nvidia-stock-q2-preview-blackwell-and-liquid-cooling-could-form-killer-combination><strong>seekingalpha</strong></a>\n\n\n</h4>\n\n</header>\n<article>\n<div>\n<p>Nvidia's key partner, Super Micro Computer, recently reported the delivery of direct liquid cooling (DLC) systems for NVDA chips.NVDA’s Blackwell AI chips, when combined with DLC, could fundamentally ...</p>\n\n<a href=\"https://seekingalpha.com/article/4716104-nvidia-stock-q2-preview-blackwell-and-liquid-cooling-could-form-killer-combination\">Source Link</a>\n\n</div>\n\n\n</article>\n</div>\n</body>\n</html>\n","isBrief":false,"type":0,"news_type":1,"symbol":"IE00BFSS8Q28.SGD","symbol_name":"Janus Henderson Balanced A Inc SGD-H","start_time":0,"source_url":"https://seekingalpha.com/article/4716104-nvidia-stock-q2-preview-blackwell-and-liquid-cooling-could-form-killer-combination","article_id":"2461814047","we_media_id":null,"thumbnails":["https://static.seekingalpha.com/cdn/s3/uploads/getty_images/1141488976/image_1141488976.jpg"],"rights":null,"url":"https://stock-news.laohu8.com/highlight/detail?id=2461814047","pubTimestamp":1724229809,"sourceInfo":{"source_id":"seekingalpha","name":"Seeking Alpha"},"weMediaInfo":null,"summary":"Nvidia's key partner, Super Micro Computer, recently reported the delivery of direct liquid cooling (DLC) systems for NVDA chips.NVDA’s Blackwell AI chips, when combined with DLC, could fundamentally ","collect":0,"end_time":0,"defaultTopTitle":"seekingalpha.com","property":[],"viewcount":null,"language":"en","relate_stocks":{"IE00BFSS8Q28.SGD":"Janus Henderson Balanced A Inc SGD-H","LU1861220033.SGD":"Blackrock Next Generation Technology A2 SGD-H","IE00B19Z8W00.USD":"FTGF CLEARBRIDGE US LARGE CAP GROWTH \"A\" INC","IE00B1BXHZ80.USD":"Legg Mason ClearBridge - US Appreciation A Acc USD","LU0069063385.USD":"SUSTAINABLE GLOBAL THEMATIC PORTFOLIO \"A\" (USD) ACC","BK4554":"元宇宙及AR概念","BK4532":"文艺复兴科技持仓","LU0077335932.USD":"FIDELITY AMERICAN GROWTH \"A\" INC","BK4592":"伊斯兰概念","IE00B7KXQ091.USD":"Janus Henderson Balanced A Inc USD","IE00B4JS1V06.HKD":"JANUS HENDERSON BALANCED \"A2\" (HKD) ACC","BK4534":"瑞士信贷持仓","IE0004086264.USD":"BNY MELLON GLOBAL OPPORTUNITIES \"A\" (USD) ACC","BK4533":"AQR资本管理(全球第二大对冲基金)","IE0004091025.USD":"BNY MELLON GLOBAL OPPORTUNITIES \"B\" (USD) ACC","IE00BD6J9T35.USD":"NEUBERGER BERMAN NEXT GENERATION MOBILITY \"A\" (USD) ACC","IE00B19Z9505.USD":"美盛-美国大盘成长股A Acc","IE00BMPRXQ63.HKD":"NEUBERGER BERMAN NEXT GENERATION CONNECTIVITY FUND \"A\" (HKDHDG) ACC","LU0053666078.USD":"摩根大通基金-美国股票A（离岸）美元","LU0072462426.USD":"贝莱德全球配置 A2","IE00BMPRXR70.SGD":"Neuberger Berman 5G Connectivity A Acc SGD-H","IE00BDCRKT87.USD":"PINEBRIDGE GLOBAL DYNAMIC ASSET ALLOCATION \"ADC\" (USD) INC","LU1861215975.USD":"贝莱德新一代科技基金 A2","BK4543":"AI","BK4527":"明星科技股","LU0048584097.USD":"FIDELITY FUNDS  GLOBAL THEMATIC OPPORTUNITIES \"A\" (USD) INC","IE00BZ199S13.USD":"BNY MELLON MOBILITY INNOVATION \"B\" (USD) ACC","BK4579":"人工智能","IE00BJJMRY28.SGD":"Janus Henderson Balanced A Inc SGD","BK4588":"碎股","BK4503":"景林资产持仓","IE00BMPRXN33.USD":"NEUBERGER BERMAN 5G CONNECTIVITY \"A\" (USD) ACC","LU0056508442.USD":"贝莱德世界科技基金A2","IE00BDRTCR15.USD":"PINEBRIDGE GLOBAL DYNAMIC ASSET ALLOCATION \"ADC\" (USD) INC A","LU0053671581.USD":"摩根大通美国小盘成长股 A(dist)","IE0005OL40V9.USD":"JANUS HENDERSON BALANCED \"A6M\" (USD) INC","IE00BK4W5L77.USD":"HSBC GLOBAL FUNDS ICAV US EQUITY INDEX \"HC\" (USD) ACC","BK4581":"高盛持仓","SMCI":"超微电脑","IE00BK4W5M84.HKD":"HSBC GLOBAL FUNDS ICAV US EQUITY INDEX \"HC\" (HKD) ACC","NVDA":"英伟达","IE00BWXC8680.SGD":"PINEBRIDGE US LARGE CAP RESEARCH ENHANCED \"A5\" (SGD) ACC","LU0061474705.USD":"THREADNEEDLE (LUX) GLOBAL DYNAMIC REAL RETURN \"AU\" (USD) ACC","IE00BFSS7M15.SGD":"Janus Henderson Balanced A Acc SGD-H","IE00B19Z8X17.USD":"FTGF CLEARBRIDGE US LARGE CAP GROWTH  \"AG\" (USD) ACC","BK4549":"软银资本持仓","LU0006306889.USD":"SCHRODER ISF US LARGE CAP \"A\" (USD) INC AV","BK4548":"巴美列捷福持仓","BK4170":"电脑硬件、储存设备及电脑周边","LU0061475181.USD":"THREADNEEDLE (LUX) AMERICAN \"AU\" (USD) ACC"},"translate_title":"英伟达Q2前瞻：Blackwell和液冷可能形成杀手组合","themeId":null,"isJumpTheme":false,"ttsUrl":null,"symbols_score_info":{"NVDA":1,"SMCI":0.7},"content_text":"Nvidia's key partner, Super Micro Computer, recently reported the delivery of direct liquid cooling (DLC) systems for NVDA chips.NVDA’s Blackwell AI chips, when combined with DLC, could fundamentally shift the cost structure for AI developers and end users.I expect to see this catalyst reflected in NVDA’s upcoming Q2 earnings report.The potential energy saving and performance boost are so significant and thus will materially widen NVDA’s long-term competitive moat in my view.   Antonio Bordunovi NVDA stock Q2: Potential impacts from direct liquid cooling I last wrote on Nvidia Corporation (NASDAQ:NVDA) earlier this month (on August 1, 2024 to be exact). That article was titled “Nvidia: Inventory And LLM Demand Point To Another Monstrous Quarter”. As you can guess from the title already, that article focused on the recent developments of its inventory and LLM (large language models) training demands. Quote: Recent inventory data shows a buildup for key rivals such as AMD. In contrast, NVDA sits on record low inventory. Together with its higher unit price, this serves as a clear sign for robust volume and superior pricing power for NVDA. I further project demand from training/deploying Large Language Models to continue. These catalysts all point to another quarter of outsized growth for NVDA. Since my last writing, there have been several new developments that merit a follow-up analysis. The most important developments are twofold in my mind. First, its key partner, Super Micro Computer, Inc. (SMCI) released its fiscal Q4 earnings report (ER) in the middle of the month. SMCI ER described several developments of relevance to NVDA, in particular, the progress it made on its direct liquid cooling (DLC) technologies. Advancements on this front, combined with NVDA’s new chips, could lead to fundamental shift in the cost structural of AI applications in my view. Second, NVDA’s own Q2 ER also approaches. The company is scheduled to report its FY Q2 earnings on Aug 28, 2024, after market close. Many analysts have updated their forecasts recently as you can see from the chart below. The majority of the revisions were upward (36 of them) with only 3 downward revisions. Currently, the consensus EPS forecast stands at $0.64. In contrast, the reported EPS for the same quarter in 2023 was $0.25 only. Thus, the forecasts point to another quarter of triple-digit growth rate. Given this development, the remainder of this article will be a preview of NVDA’s Q2 earnings. I will argue why I totally share the analysts' bullish outlook for its upcoming Q2.   Seeking Alpha NVDA stock and SMCI liquid-cooled clusters The growth drivers I detailed in my last article are of course still valid. To recap, these drivers include superior pricing power and robust demand, both reflected in its record-low inventory currently. Therefore, here, I want to concentrate on a new catalyst that was reported in SMCI’s fiscal Q4 ER. I want to stay on point and do not want to make this analysis an earnings review for SMCI’s Q4. I will risk being terse and only pointing out the parts that are mostly relevant to my thesis here. Overall, SMCI reported a monstrous quarter in my view with 143% YOY growth and 38% growth QoQ as seen in the slide below. As a key partner for NDVA, such growth rates serve as another supporting sign for NVDA’s own growth in the past quarter. What I really want to focus on here is the development of SMCI’s DLC technology. SMCI reported in its Q4 ER the delivery of its 8U liquid-cooled clusters for NVIDIA’s H100 AI chips (the first one to market). Next, I will explain why the advancement in DLC and NVDA chips could form a killer combination for AI applications.   SMCI 2024 FY Q4 earnings slide NVDA stock: cooling is an AI bottleneck Out of all the roadblocks (technical, legal, ethical, etc.) for more expansive AI deployment, cooling and the associated energy consumption is a key roadblock. NVDA’s H100 chip consumes 700W of energy at peak operation, more than the average consumption of American households. Most of this power is converted into waste heat, and only a negligible amount is used for the actual computing. This huge amount of waste is also restricted to a tiny volume, given the small footprint of modern-day chips. A large amount of heat confined to a small volume is the perfect recipe for a cooling nightmare. Such a nightmare translates into many practical issues, and the top two on my lists are reduced performance and high energy cost. To avoid overheating, chips do not (or cannot) run at their designed specifications all the time. Better cooling thus could help unleash the full potential of NVDA’s leading chips and SMCI’s liquid-cooled racks are designed for this purpose, as you can read from its following news release (the emphases were added by me): With Supermicro's 4U liquid-cooled, NVIDIA recently introduced Blackwell GPUs can fully unleash 20 PetaFLOPS on a single GPU of AI performance and demonstrate 4X better AI training and 30X better inference performance than the previous GPUs with additional cost savings. Aligned with its first-to-market strategy, Supermicro recently announced a complete line of NVIDIA Blackwell architecture-based products for the new NVIDIA HGX™ B100, B200, and GB200 Grace Blackwell Superchip. Note that a complete line of these racks is specially designed for NVDA’s Blackwell chips, which leads me to the next key practical issue of energy cost. In practice, data centers employ high-end chips in the thousands and the power demand can bring down the power grid of a region (see the following X.com comments from a Microsoft engineer).   Source: X.com It’s always fun to run a topic like this on social media. However, for business operations, this means an outsized electricity bill. As an estimate for the cost breakdown for training/deploying AI Models, I gather the following inputs from this Forbes report (slightly edited with emphases added by me):   The cost of the chips amounted to millions of dollars. According to a technical overview of OpenAI’s GPT-3 language model, each training run required at least $5 million worth of GPUs. These models require many, many training runs as they are developed and tuned, so the final cost is far in excess of this figure. When asked at an MIT event in July whether the cost of training foundation models was on the order of $50 million to $100 million, OpenAI’s cofounder Sam Altman answered that it was “more than that” and is getting more expensive. The cost doesn’t end there. Running inference on the models, once trained, is also expensive. Estimates suggest that in January 2023, ChatGPT used nearly 30,000 GPUs to handle hundreds of millions of daily user requests. Sajjad Moazeni, a University of Washington assistant professor of electrical and computer engineering, says those queries may consume around 1 GWh each day.   I need to assume a cost of electricity per kilowatt-hour (kWh) to convert the above consumption into a dollar amount. I will just use my own electricity price of ~$0.14 per kWh for this purpose (as a broader context, electricity costs are in the range of $0.12 to $0.17 per kWh in the U.S.). Under this assumption, 1 GWh per day means an electricity bill of $140,000 PER DAY. Or $51 million per year, which is more than tenfold of the GPUs' upfront costs and on the same order of magnitude as the energy cost to train the model. NVDA’s Blackwell boasts both improved performance and drastically higher energy efficiency. As you can see from the following slide below, Blackwell is designed to deliver 30x higher throughput and 25x energy efficiency compared to earlier generations. With the help of liquid cooling, these chips can spend more time running at their peak performance. The DLC racks are more energy efficient themselves and thus require lower power to operate. All of these point to a significant reduction in electricity consumption, and thus lower energy costs for training and deploying, large-scale AI models.   NVDA investor presentation Other risks and final thoughts In terms of downside risks specific to my above forecast, the top risk is the technical issues and delays the Blackwell chips are experiencing now. Its Blackwell product line is experiencing technical issues in reaching the target volume production. More details are summarized in the following chart. More specifically, … setback has impacted their production targets for Q3/Q4 2024 as well as the first half of next year. This affects Nvidia’s volume and revenue, as we detailed in the Accelerator Model on July 22nd. In short Nvidia’s Hopper is extended in lifespan and shipments to make up for a chunk of the delays. Product timelines for Blackwell are pushed out some, but volumes are affected more than the first shipment timelines. All told, I believe these setbacks to be only temporary and do not change the underlying force at work here. To recap, I believe the combination of NVDA’s next-generation AI chips with DLC has the potential to fundamentally shift the budget allocation for AI developers and also end users. I further expected such a shift to be reflected in NVDA’s upcoming release of its financials in the past quarter. Looking further out, my view is that the potential energy saving is so large that it will help to further widen NVDA’s competitive moat.    SemiAnalysis","kind":"highlight","is_publish_news":true,"is_publish_highlight":false,"is_publish_live":false,"is_publish_wemedia":null,"editions":null,"column":"","sentiment":"1","news_tag":"","news_rank":0,"symbols":[],"gpt_button":0},"commentList":[],"isCommentEnd":true,"newsSizeData":{"likeSize":2,"commentSize":0,"repostSize":1,"favoriteSize":0,"likeStatus":false,"favoriteStatus":false},"APP":{"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","isDev":false,"isTTM":true,"deviceId":"web-server-community-laohu8-v3","version":"4.29.3","shortVersion":"4.29.3","platform":"web","vendor":"web","appName":"ttm","isIOS":false,"isAndroid":false,"isTiger":false,"isTHS":false,"isWeiXin":false,"isWeiXinMini":false,"isWeiBo":false,"isQQ":false,"isBaiduSwan":false,"isBaiduBox":false,"isDingTalk":false,"isToutiao":false,"isOnePlus":false,"isHuaWei":false,"isXiaomi":false,"isXiaomiWebView":false,"isOppo":false,"isVivo":false,"isSamsung":false,"isMobile":false},"href":"/m/news/2461814047"}