Entry № 041-3 / V-813 · 0:00 synced

This is NVIDIA’s new GPU - Blackwell NVL72 Rack

Linus Tech Tips@LinusTechTips1.9M viewsJun 4, 202412:57
Source
YT
Views
1.9M
Subscribers
16.8M
Critic
?
Audience
?

0 up · 0 down · 0 ratings

Description

Get a 15-day free trial for unlimited backup at backblaze.com

Promos

Check out Ridge’s Father’s Day sale at ridge.com and enjoy up to 40% off! Linus explores the NVIDIA booth at Computex 2024 looking at one of the LARGEST GPUs we have ever seen, well since its the size of a Server Rack. They also look at Network switches, and use cases for AI in Video Gamers! Discuss on the forum: linustechtips.com Purchases made through some store links may provide some compensation to Linus Media Group. ► GET MERCH: lttstore.com ► GET EXCLUSIVE CONTENT ON FLOATPLANE: lmg.gg ► GET A VPN: piavpn.com ► SPONSORS, AFFILIATES, AND PARTNERS: lmg.gg ► EQUIPMENT WE USE TO FILM LTT: lmg.gg ► OUR WAN PODCAST GEAR: lmg.gg FOLLOW US --------------------------------------------------- Twitter: twitter.com Facebook: @LinusTech Instagram: @linustech TikTok: @linustech Twitch: twitch.tv MUSIC CREDIT --------------------------------------------------- Intro: Laszlo - Supernova Video Link: youtube.com iTunes Download Link: itunes.apple.com Artist Link: soundcloud.com Outro: Approaching Nirvana - Sugar High Video Link: youtube.com Listen on Spotify: spoti.fi Artist Link: youtube.com Intro animation by MBarek Abdelwassaa @mbarek_abdel Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us CHAPTERS --------------------------------------------------- 0:00 Intro 2:33 B200 Specs 3:24 The Super Chip 4:10 The Spline? 4:57 Full Tower GPU 6:23 HGX Unit 8:01 NVidia Network Switch 8:24 Use Cases for all this Power 9:12 Use Cases for Gamers 12:45 Outro

Start
AI OverviewDefault language

NVIDIA’s unveiling of the Blackwell NVL72 rack centers on scale, interconnectivity, and real world use cases that push both gaming and data center workloads. In the early segment, the host highlights the B200 Blackwell super chip assembly, noting that these dies are paired and connected by an ultra-tiny interconnect gap, enabling multiple GPU dies to function as a single unit. The discussion emphasizes that this is not a consumer GPU but a datacenter grade solution designed to deliver vastly higher performance through NVLink interconnects and a tightly integrated rack design. The crew then breaks down the power and cooling requirements, revealing a system that runs on roughly a kilowatt per GPU with liquid cooling, and they explain the architectural intent of the NVL72 rack as a single, massive GPU-like processing entity, assembled from multiple boards and switch units for ultra-low latency and high bandwidth. They also explore the broader ecosystem, including the MGX and HGX design philosophies, and explain how the NVL72 integrates with Nvidia networking hardware for a complete compute, memory, and interconnect stack. As the tour shifts to applications, the host demonstrates potential use cases across healthcare, climate modeling, and game development with NIMS, autonomous data pipelines, and on-device inference, underscoring how AI workloads like protein folding, drug discovery, and in-game animation can scale with specialized hardware. The video wraps with considerations for developers and gamers, noting that Nvidia will support partner systems and reference DGX configurations, while highlighting ongoing demonstrations of real-time speech-to-mouth animation and AI-assisted storytelling through NIMs, ending with a teaser about future demonstrations and community engagement. Across the presentation, the host communicates a sense of awe about the engineering feat, the sheer data throughput, and the potential for accelerating AI training and inference. The narrative ties the hardware capabilities to tangible outcomes: orders of magnitude performance improvements, linear scaling across multi-die GPUs, and the ability to deploy advanced AI services without resorting to bespoke, custom-built infrastructure. The tone remains pragmatic about power requirements and cooling, while optimistic about how this hardware translates into faster drug discovery, smarter medical imaging, and more immersive game development pipelines. Overall, the video positions the NVL72 rack as a landmark in GPU-centric HPC, with layered components from compute blades to high-speed networking that collectively redefine what a single rack can achieve for AI and simulation workloads.

Topics · science_and_technology · data_center · ai · gpu_computing · high_performance_computing · gaming_tech