We’ve NEVER done this before… - Mother Vault Part 1 - JBOD
0 up · 0 down · 0 ratings
Description
Check out the SuperMicro JBOD: lmg.gg
Promos
Get $25 off all pairs of Vessi Footwear with offer code LinusTechTips at vessi.com Get your Crucial DDR5 RAM today at: crucial.gg We've built some cool machines on the channel, but nothing is even close to the plan for our 3.6-petabyte archival storage array. Discuss on the forum: linustechtips.com
Check out InfiniteCable's MiniSAS HD external cables: lmg.gg Purchases made through some store links may provide some compensation to Linus Media Group. ► GET MERCH: lttstore.com ► SUPPORT US ON FLOATPLANE: floatplane.com ► AFFILIATES, SPONSORS & REFERRALS: lmg.gg ► PODCAST GEAR: lmg.gg FOLLOW US --------------------------------------------------- Twitter: twitter.com Facebook: @LinusTech Instagram: @linustech TikTok: @linustech Twitch: twitch.tv MUSIC CREDIT --------------------------------------------------- Intro: Laszlo - Supernova Video Link: youtube.com iTunes Download Link: itunes.apple.com Artist Link: soundcloud.com Outro: Approaching Nirvana - Sugar High Video Link: youtube.com Listen on Spotify: spoti.fi Artist Link: youtube.com Intro animation by MBarek Abdelwassaa @mbarek_abdel Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us CHAPTERS --------------------------------------------------- 0:00 Intro & History 4:19 The JBOD 9:15 The Computer 14:10 FILLED 15:26 Cabling & Zoning 16:23 It's... LOUD 18:19 IPMI 18:54 What about dual path & high availability? 19:58 It's aliveeee! 21:30 Performance testing & outro
The video kicks off with an energetic, almost chaotic preview of the scale of the project, presenting the vault-like storage endeavor as a monumental engineering challenge. It opens with a lighthearted jab at the grunt work ahead, then immediately grounds the viewer in the reality that the team is dealing with an enormous 3.6 petabyte archival storage array. The hosts recount past attempts and why the older GlusterFS-based clusters were less than ideal for scaling and maintenance, explaining the decision to pivot to a JBOD based approach. They describe the new architecture as consisting of three large JBOD enclosures, each capable of housing nearly two petabytes of hard drive storage, driven by a dedicated head server to manage the drives. The segment emphasizes the beauty and complexity of JBODs, highlighting the absence of a traditional compute node inside the chassis and the reliance on external compute for data processing. Throughout, the hosts mix technical explanations with humor and banter about the heaviness of the hardware, giving viewers a sense of both the ambition and the potential pitfalls of the build.
Topics · technology · hardware · data_storage · data_center
Questions answered
- What is the purpose of the Mother Vault JBOD project?
- The project aims to create a scalable, petabyte-scale archival storage array using JBOD enclosures with a head server to manage drives, enabling centralized storage for the channel's large data needs.
- Why did the team move away from GlusterFS to JBOD with a head server?
- GlusterFS required more staff familiarity and maintenance, and scaling with multiple independent clusters was becoming inefficient; JBOD offers a simpler, centralized approach with potential for higher throughput and easier maintenance.
- How many JBOD units are planned and what capacity do they offer?
- Three JBOD units are planned, each capable of housing nearly two petabytes of disk storage, connected to a head server for coordination.
- What is IPMI and why is it mentioned in this setup?
- IPMI is an out-of-band management interface used to monitor and manage the hardware, including remote power and health status, which is important for large, headless storage arrays.
- What role do SAS expanders play in this JBOD design?
- SAS expanders distribute bandwidth from the head to many drives, enabling up to 90 drives per JBOD when using the correct zoning and multiple expanders.