Enterprises are rebuilding their digital foundations as artificial intelligence accelerates demand for smarter, more resilient AI infrastructure.

Across the industry, teams are reconsidering how tightly their systems need to work together to keep up with modern workloads. The pressure to move faster and handle more data is reshaping expectations for how next-generation platforms are designed, according to Vik Malyala (pictured), managing director and president, EMEA, and senior vice president of technology and AI at Super Micro Computer Inc.

“As we look into AI deployments, one of the things that we kind of literally leveraged on that is because we do develop everything in-house,” Malyala said. “That helped us to adapt to the changes very quickly and be able to bring the platforms that are more relevant for different verticals, whether it’s enterprise or cloud or even [the] HPC side of it.”

Malyala spoke with theCUBE’s John Furrier and Jackie McGuire at SC25, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed the evolution of AI infrastructure, the role of open standards, ecosystem collaboration and the challenges and opportunities facing enterprises as they build the next generation of AI-powered systems. (* Disclosure below.)

Partnerships and open standards drive AI infrastructure growth

Organizations are increasingly turning to modular, high-density systems to meet the demands of modern workloads. This approach allows enterprises to scale efficiently and adapt quickly as requirements evolve, according to Malyala.

“In order to reduce that total cost of the networking overhead and everything, nodes need to be next to each other,” he said. “In fact, we worked with Intel, and we were the first to introduce the twin platform, which pretty much is a de facto standard now in a compute world.”

Open standards and ecosystem collaboration are central to the evolution of AI infrastructure, Malyala explained. By adopting industry best practices and working with a broad range of partners, organizations can offer customers greater flexibility and choice.

“It takes a village to get things done,” he said. “If you take a look at [the] standards point of view … we started with all the 19-inch standard rack designs and everything, which is open standards, and we started adopting the best practices in the industry … whoever you think is actually focusing on high performance, high resiliency, we are working with them to do that.”

Maximizing the use of expensive compute resources, especially GPUs, is a growing priority for enterprises. As workloads diversify and new accelerators enter the market, organizations are seeking ways to keep systems productive and costs under control, Malyala pointed out.

“There’s so many companies that are coming up and working on solving this problem because … it’s all started with training workloads, which were beating up the systems as much as possible as long as the network and storage is there to support them,” he said. “The other thing is heterogeneity. When people start adopting all this … it’s about how we keep the GPUs busy and how we improve the productivity and how we bring the total cost of ownership down.”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of SC25:

(* Disclosure: TheCUBE is a paid media partner for SC25 event. Sponsors of theCUBE’s event coverage do not have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE