UPDATED 17:42 EST / OCTOBER 29 2024

AI

GPU cloud operator GMI Cloud secures $82M investment

Cloud infrastructure startup GMI Cloud Inc. today announced that it has closed a $82 million early-stage funding round led by Headline Asia.

The Series A investment also included the participation of Thailand-based energy company Banpu Next and Wistron Corp., a Taiwanese electronics maker. The bulk of the round, $67 million, took the form debt financing. The remaining $15 million was provided as equity funding.

Santa Clara, California-based GMI Cloud operates an infrastructure-as-a-service platform geared towards artificial intelligence workloads. The platform provides access to Nvidia Corp.’s H100 graphics processing units. A few weeks from now, GMI Cloud will also start offering the H200, an upgraded version of the H100 with more memory.

For users, spinning up a GPU-powered cloud instance usually takes several minutes. GMI Cloud says that its platform performs the task in a few fractions of a second. Customers can link together their instances into a cluster and, if necessary, run multiple clusters side by side. 

After spinning up a GPU environment, developers have to install the AI model they plan to run along with the external software components the model requires to work. Configuring those components can require a significant amount of time. To speed up the task, GMI Cloud provides preconfigured AI software that can be deployed without extensive customization. 

The company offers access to NIMs, Nvidia-developed versions of popular AI models. NIMs are packaged into containers to ease deployment. They also include performance optimizations designed to make AI models run faster on Nvidia silicon. 

For customers with more advanced requirements, GCI Cloud offers the ability to deploy custom models on its cloud. The platform integrates with several of the code editing tools that developers most commonly use to build AI applications. It also supports open-source machine learning frameworks such as PyTorch.

Under the hood, GCI Cloud’s platform is powered by a Kubernetes-based infrastructure management platform called Cluster Engine. The software automates the task of provisioning new instances and allocating hardware resources to AI workloads. If one of the servers on which a model runs experiences technical issues, Cluster Engine can move the data inside to a different machine without incurring downtime. 

Since launching in 2022, GMI Cloud built up a user base that includes several dozen companies. The company says that its customers include healthcare, telecommunications and research organizations.

GMI Cloud relies on data centers in Taiwan, Thailand and Malaysia to host customers’ workloads. It will use the funding round announced today to build a cloud facility in Colorado. Additionally, the company reportedly plans to hire up to 20 new employees by the end of the year. 

Image: Unsplash

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.