AI
AI
AI
Nvidia unveils first look at Eos, its latest data center-scale supercomputer
Nvidia Corp. today provided the first public look at the architecture powering Eos, the company’s latest data center-scale supercomputer designed for accelerating artificial intelligence development, described as an “AI factory.”
Revealed in November during the Supercomputing 2023 trade show, Eos is named after the Greek goddess who is the personification of dawn. The supercomputer is built with 576 Nvidia DGX H100 systems combined with Quantum-2 InfiniBand networking and software to provide a total of 18.4 exaflops of FP8 AI performance.
Nvidia said it built Eos based on prior knowledge from previous supercomputer architectures, including the Nvidia SaturnV and the modular supercomputer Selene. The entire system architecture is built into an extremely large-scale DGX SuperPOD, which allows system architects to rapidly scale up AI data center solutions with extremely high performance.
Under the hood, every DGX H100 supports eight H100 Tensor Core APUs and Eos itself features a total of 4,608 H100 GPUs. This means that the entire system will be able to handle tremendous workloads to train large language models, AI recommenders, large-scale analytics, quantum simulations and more, the company said.
According to Nvidia, the architecture for Eos has been optimized for AI workloads, which demand ultra-low latency and high throughput across large clusters of accelerated computing nodes. Using Nvidia’s own networking technology, the supercomputer can support data transfer speeds of up to 400GB/s, which are needed to move extremely large datasets for training AI models.
Software integrated into the Eos supercomputer includes offerings such as Base Command and AI Enterprise. Base Command provides powerful AI workflow management, cluster management and libraries for accelerated compute, storage and network infrastructure for running AI workloads. AI Enterprise is a cloud-native platform designed to help accelerate and streamline the development and deployment of AI applications, including generative AI by being the “operating system” for enterprise AI, the company said.
In November, Eos won the ninth slot on the TOP500 list of the world’s fastest supercomputers.
Photo: Nvidia
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
