The Rise of High-Performance Cloud Storage for AI

At this year’s GTC conference, NVIDIA unveiled major innovations, showcasing its vision for accelerating the growth of artificial intelligence. Imagine a world where cloud data storage services predicts the weather with pinpoint accuracy and crafts stories that captivate our imagination or designs art that moves the soul. This future is closer than you think, thanks to NVIDIA’s latest breakthroughs. And that future requires more compute and storage power than ever before.

Transforming AI from Data Analyzers to Data Generators

Lightbits high performance block storage with Jensen Huang, CEO of NVIDIA

Lightbits caught up with one of the titans of AI, Jensen Huang, CEO of NVIDIA, at NVIDIA GTC.

In his keynote, NVIDIA CEO Jensen Huang spoke about the deluge of data and the rise of massive AI models that traditional computing architectures can no longer support. He highlighted how the volume of data being generated is exploding exponentially, while AI models are becoming larger and more computationally intensive than ever before. In simple terms, the amount of information we’re creating and the complexity of AI tasks are growing so fast that traditional computing approaches can’t keep up. Huang pointed out we’ve hit a moment where we need new computing architectures to handle the huge demands of advanced AI applications.Generative AI emerged as a star in Huang’s presentation. This new breed of AI can generate original content – like pictures, writing, and even computer code – transforming AI from mere data analyzers into creators. Additionally, Huang unveiled NVIDIA’s roadmap for an AI-powered ecosystem. This plan isn’t just about making smarter machines; it’s about integrating AI into every facet of the physical and digital world, from robots that could be our hands and feet in distant locations to simulations that can predict the outcome of complex scenarios before they happen.

 

Today’s AI Clouds Demand More from Cloud Data Storage Services and Compute Infrastructure

The introduction of products like the Blackwell GPU series, DGX GB200 NVL72 System, and DGX SuperPOD signals NVIDIA’s commitment to equip the tech world with the infrastructure needed for the AI revolution. These aren’t just hardware; they’re the keys to unlocking AI’s future, designed to process AI tasks faster and more efficiently than before.

Cloud builders play a vital role in this ecosystem. They take NVIDIA’s cutting-edge technology and build cloud platforms that allow businesses and developers to use powerful AI without having their own supercomputers. This partnership is vital for bringing NVIDIA’s vision to life, making AI advancements accessible to everyone.

Today at NVIDIA GTC, Lightbits customer Crusoe revealed it will be among the first cloud service providers to offer instances powered by the new NVIDIA Blackwell architecture. This move aligns with Crusoe’s commitment to sustainable, reliable, and cost-effective cloud and AI systems, leveraging unused clean energy to reduce environmental impact while advancing AI infrastructure.

Some background on Crusoe AI Cloud: in 2023 they wanted to expand their IaaS offering by including robust and high-performance block storage. After considering several potential options, including other vendors and open-source software projects such as Ceph, they implemented Lightbits. Lightbits was superior in terms of IOPS, with notably lower latencies, even when operating on the same hardware. Lightbits utilizes NVMe/TCP, a protocol pioneered by Lightbits (part of the NVMe-oF standard), that enables direct access to NVMe storage over Ethernet networks. This innovative approach significantly reduces latency and maximizes throughput, making it ideal for demanding AI and ML workloads.


High-Performance Block Storage as the Foundation for AI Platforms

Lightbits partner, ICC, received accolades as NVIDIA’s “Rising Star,” integrating AI with innovative solutions, showcasing the power of high-performance computing when combined with efficient storage solutions like those provided by Lightbits.

Lightbits demonstrates fast, scalable block storage in the ICC booth at NVIDIA GTC.

Lightbits demonstrates fast, scalable block storage in the ICC booth at NVIDIA GTC.

 

With Lightbits block storage in their toolkit, ICC helps customers architect and build high-performance AI clouds for scale. These AI experts can help you engineer a platform for dynamic, fast resource provisioning and allocation, that reduces administrative overhead, and an AI platform that is flexible and resilient.

 

Lightbits Cloud Data Storage Services Delivers More for AI Clouds

The Lightbits cloud data platform is revolutionizing how enterprises build AI clouds, offering a solution that meets and exceeds the demands for high-performance, scalable, and cost-efficient block storage. Our AI customers have realized that file and object storage aren’t enough–they need block storage too.

Lightbits takes fast, scalable block storage to NVIDIA GTC.

Lightbits takes fast, scalable block storage to NVIDIA GTC.

The Lightbits data platform gives them high-performance, scalable, cost-effective block storage that improves AI workflows including:

  • Streamlining data pre-processing
  • Accelerating model training
  • Speeding up real-time inference
  • Optimizing databases for peak performance
  • Delivering more scalability and greater flexibility

Today, our customers are using the Lightbits to support AI pipelines with high-performance databases including vector databases, and to store and manage AI workload-specific operating system images for their private cloud and cloud services customers.

“Lightbits on Micron SSDs blew everything else out of the water, with consistently higher throughput, IOPS, and lower latency across the board. We were impressed with the performance and consistency of Lightbits.” – Mike McDonald, product manager, Crusoe

As AI continues to require more from our computing infrastructure, Lightbits ensures that data flows smoothly, enhancing everything from data preprocessing and model training to real-time inference. This advancement is critical, transforming storage from a potential bottleneck to a powerful accelerator of AI workflows.

We all stand on the cusp of this new era. The collaboration between NVIDIA, cloud builders, and technology providers like Lightbits is more than just a fleeting trend. It’s a shared vision for a future where AI’s full potential can be realized across the globe, driving innovation, solving complex challenges, and opening up new horizons for humanity.

 

About the Writer: