Token sticker shock pushes enterprises from frontier labs toward open-weight AI factories
Enterprises have spent the AI boom racing to secure GPUs, but the harder decisions now sit above the hardware. Token bills, data sovereignty and model choice increasingly decide which AI pilots reach production, a shift on display at the SC26 supercomputing conference.
Dell Technologies Inc. has spent the past year pushing its AI Factory beyond servers and storage. Customers now want a full-stack outcome that covers software, open-source tools, models and operations, according to Brad Maltz (pictured), senior director of AI solutions at Dell.
“The hardware’s key, because that drives the tokens,” Maltz said. “You really, truly need a full-stack AI factory view above and beyond just the hardware stack.”
Maltz spoke with theCUBE Research’s John Furrier and Gemma Allen at SC26, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed how token bills and data sovereignty are steering enterprises toward open-weight models and a full-stack AI Factory. The interview came as Dell rolled out AI Factory updates at the conference. (* Disclosure below.)
Why GPUs alone won’t carry AI pilots into production
Many enterprises are still stuck in pilot mode, and coding assistants are often the easiest place to start. Employees have already tried tools from Anthropic PBC and OpenAI Group PBC, so teams want to apply that experience to business use cases. Once those pilots grow, the bill arrives, Maltz explained.
“The token spend right now in the frontier labs and the hyperscalers. That’s a little more than we expected,” Maltz said. “We didn’t expect to spend $10,000, $20,000 per person per month.”
Cost is only one trigger. Data sovereignty, intellectual property leakage, security and governance all have to be addressed before a pilot goes live. That is steering many enterprises toward open-weight models they can fine-tune and run on-premises, including U.S. options such as Nvidia Corp.’s Nemotron, according to Maltz.
“There will always be frontier labs. There will always be open-weight models,” Maltz said. “The question is going to be, do we have enough diversity with the open weights to meet the enterprise use cases?”
To keep pace, Dell launched its AI Ecosystem Program to validate software partners on its AI Factory. About 60 more partners have applied or are under evaluation, and each addition lets Dell solve 10 to 30 more customer problems, Maltz noted. For sovereign deployments, that often means disconnected, on-premises systems that keep models next to the GPUs and data enterprises already control.
“People understand data is the lifeblood of AI,” Maltz said. “It’s the thing that trains the models. It’s the thing the models operate against. It comes from your enterprise business applications.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of SC26:
(* Disclosure: Dell Technologies Inc. sponsored this segment of theCUBE. Neither Dell Technologies Inc. nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
Photo: SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
About SiliconANGLE Media
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.