Dell looks to advance AI data center solutions for scalable enterprise innovation
The enterprise artificial intelligence landscape is changing rapidly and companies are seeking solutions that meet diverse data center needs. There’s a focus on creating scalable, efficient and user-friendly AI data center solutions to bridge the demands of companies in this new era.
In recent years, customers have been seeking a variety of AI data center solutions. These solutions span different shapes, sizes and capabilities to meet diverse needs, according to David Schmidt (pictured), senior director of PowerEdge product management at Dell Technologies Inc.
“They really need things that fit their existing data centers,” Schmidt said. “There are certainly use cases where customers are looking to build new data centers … but we have to meet customers where they are today and provide them with powerful AI solutions.”
Schmidt spoke with theCUBE Research’s Dave Vellante and Savannah Peterson at SC24, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed the spectrum of AI computing solutions and the innovative strategies enabling high-performance infrastructure. (* Disclosure below.)
AI data center solutions outlined
When it comes to AI solutions, some of that can be done with the compute-based solutions being built with PowerEdge, according to Schmidt. That involves a breadth of solutions.
“We can deliver AI on compute as well as purpose-built, large-scale AI solutions and we’re doing that with systems built on fifth-generation AMD Turin,” Schmidt said. “We’re really excited to have new servers, new rack-based servers that are supporting latest-generation Turin processors.”
Around SC24, there have been several liquid cooling or alternative cooling stations. But some customers aren’t ready for that in their data centers, according to Schmidt.
“We are really focused on providing compelling air-cooled designs that they can fit inside their existing power and thermal footprint inside their racks, inside their data centers,” he said. “Then, it’s a matter of crafting the right AI solution and use cases and the right-sizing that’s going to work for that type of environment.”
These days, companies are wondering how they can deploy and demystify AI solutions for their environments, according to Schmidt. That doesn’t mean they want to buy a new data center with many wanting to continue utilizing a previous investment.
“The AI Factory is no surprise. I love it. I think we do really great things. We have reference architecture, we have validated designs that run the entire spectrum,” he said.
The Llama 3.2, for instance, is considered a small language model and has three billion parameters. Dell can support 100 concurrent users on a standard two-socket rack server running a 128-core Turin, according to Schmidt.
“That’s the kind of footprint, because that’s the exact same type of system a customer would deploy to run just their standard IT infrastructure as well. It gives them a common install base, and they love that,” he said.
Over the coming year, companies are likely to be enabled to be successful in a variety of industries, according to Schmidt. In the view of Dell, some of that will be surprising.
“We have some really compelling conversations going on right now. We have the capability to deliver at scale in a way that is just going to accelerate customers’ time to value,” he said. “It’s just going to be awesome to sit here a year from now and have those types of conversations.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE Research’s coverage of SC24:
(* Disclosure: Dell Technologies Inc. sponsored this segment of theCUBE. Neither Dell nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
Photo: SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Your vote of support is important to us and it helps us keep the content FREE.
One click below supports our mission to provide free, deep, and relevant content.
Join our community on YouTube
Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.
THANK YOU