UPDATED 20:33 EDT / MAY 08 2024

Steven Huels, vice president and general manager of the AI Business Unit at Red Hat Inc. and Justin Boitano, vice president of enterprise AI at Nvidia Corp. discuss the unique collaboration between Red Hat and Nvidia NIM microservices with theCUBE at Red Hat Summit 2024 AI

Red Hat and Nvidia join forces to help users develop AI applications

Two artificial intelligence powerhouses, Red Hat Inc. and Nvidia Corp., are partnering together to better serve enterprise and business users with AI microservices.

“Everyone knows AI is going to play a critical role in their enterprise going forward,” said Steven Huels (pictured, right), vice president and general manager of the AI Business Unit at Red Hat. “The challenges they run into have to do with a lot of the tooling, the ease of integration, the deployment and consumption. And the partnership here is really targeted at accelerating that and mak[ing] it as easy to adopt as possible.”

Huels and Justin Boitano (left), vice president of enterprise AI at Nvidia, spoke with theCUBE’s Rob Strechay and Paul Gillin at Red Hat Summit, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed Red Hat and Nvidia’s unique partnership and what users are looking for from AI providers. (* Disclosure below.)

Steven Huels, vice president and general manager of the AI Business Unit at Red Hat Inc. and Justin Boitano, vice president of enterprise AI at Nvidia Corp. discuss the changing landscape of AI with theCUBE at RHS 2024

Justin Boitano and Steven Huels talk about what enterprises want from AI providers.

Homing in on faster, individualized models and microservices

Red Hat is partnering with Nvidia to enable users to integrate Nvidia’s NIM microservices into models trained on Red Hat OpenShift AI. The goal is to shorten time-to-market for AI applications.

“Generative AI is no good if it’s not in production,” said Boitano. “What you want to do is figure out how to drive the accuracy up to get a business outcome going, get it into production, and then you can figure out how to shrink the models and cost-reduce it and make it more cost-effective.”

Nvidia looks to balance proprietary technology with open source, giving users the tools they need to run AI models tailored to the needs of their business. The focus for companies going forward will be on customized models, predicts Huels.

“We focus on our strength, which is giving the core components you’ll need in an AI management and system,” he said. “But then we rely on our partners to go deep in specific areas. We’re going to continue to see customers journey towards smaller models, more efficient models, targeted specific use cases.”

The AI space is increasingly competitive as companies look to capitalize on the generative AI boom. But with an emphasis on collaboration and innovation, Nvidia aims to stay on top

“There’s a new industry being born through generative AI,” Boitano said. “We got to keep running faster. We got to work more with our partners to help customers achieve success quickly with generative AI, which is part of the reason for the work we do.”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE Research’s coverage of Red Hat Summit:

(* Disclosure: Nvidia Corp and Red Hat Inc. sponsored this segment of theCUBE. Neither Nvidia, Red Hat nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Support our open free content by sharing and engaging with our content and community.

Join theCUBE Alumni Trust Network

Where Technology Leaders Connect, Share Intelligence & Create Opportunities

11.4k+  
CUBE Alumni Network
C-level and Technical
Domain Experts
15M+ 
theCUBE
Viewers
Connect with 11,413+ industry leaders from our network of tech and business leaders forming a unique trusted network effect.

SiliconANGLE Media is a recognized leader in digital media innovation serving innovative audiences and brands, bringing together cutting-edge technology, influential content, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — such as those established in Silicon Valley and the New York Stock Exchange (NYSE) — SiliconANGLE Media operates at the intersection of media, technology, and AI. .

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a powerful ecosystem of industry-leading digital media brands, with a reach of 15+ million elite tech professionals. The company’s new, proprietary theCUBE AI Video cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.