Direct liquid cooling is the future of energy-efficient data centers, according to Seguente Inc., a global energy and thermal management company.

Seguente has partnered with Dell Technologies Inc. and artificial intelligence powerhouse Nvidia Corp. to transform existing computing racks so that the cooling mechanisms are more sustainable and support higher workloads.

Seguente’s Raffaele Luca Amalfi, Dell’s Tim Shedd and Nvidia’s Dion Harris discuss their collaboration.

“Cooling is just a tool to enable energy-efficient computing,” said Tim Shedd (pictured, left), engineering technologist, Office of the CTIO, at Dell Technologies Inc. “What we did with the H100 servers … we’re deploying those 64 GPUs with a rear door heat exchanger. So, we liquid-cooled the rack while keeping water out of the chassis. It turns out that met a whole bunch of TCO energy efficiency and the ability to deploy very quickly to the customer met all those requirements all at once.”

Shedd, Raffaele Luca Amalfi (right), co-founder and chief executive officer of Seguente, and Dion Harris (second from left), director of accelerated data center GTM at Nvidia Corp., spoke with theCUBE Research’s Dave Vellante at SC24, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed the difference between air and direct liquid cooling and how the latter could change computing. (* Disclosure below.)

Saving energy with direct liquid cooling

Seguente is leading the shift from indirect to direct liquid cooling, where the liquid is in the cold plate right on top of the GPU. This allows for a more densely compact compute rack, according to Harris.

“Nvidia is no longer selling a GPU,” he explained. “We’re really selling customers a data center. We’re looking at lots of different innovative ways to give more performance out of that computing stack, out of that networking stack. And oftentimes it involves driving more compute density, which therefore requires different innovations, whether it be through liquid cooling, through the bus bars, through the entire infrastructure that supports the specific computing infrastructure.”

Seguente’s solutions are also more sustainable, emphasized Amalfi. The company’s Coldware technology can capture heat, saving energy within the entire system.

“The rear door [solution] will allow us to basically capture the heat before goes into the aisle of the data centers so that you can basically offload some of the energy consumption on the HVAC systems,” Amalfi said. “If we can capture the heat at a high temperature, then we will be very sustainable because we get directly used.”

Since customers will have to retrofit existing data centers, Shedd and Harris foresee a lot of hybrid air and liquid cooling solutions. Their goal is to meet the customers where they are, with an eye toward long-term sustainability and efficiency.

“Instead of hot aisles and cold aisles, we’re talking about wet aisles and dry aisles now,” Shedd said. “We’re going to be distributing liquid through in one aisle and feeding liquid to those racks and maybe to redo heat exchangers. What this does is kind of opens up space, it opens up the operating environment so that we’re no longer constrained by all of the challenges of getting air to the racks.”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE Research’s coverage of SC24:

(* Disclosure: TheCUBE is a paid media partner for SC24. Neither Dell Technologies Inc. and WekaIO Inc., the premier sponsors of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE