UPDATED 13:12 EDT / JUNE 17 2019

AI

Habana Labs’ new Gaudi chip promises faster AI training than Nvidia GPUs

Habana Labs Ltd. is throwing down the gauntlet to Nvidia Corp. in the artificial intelligence market.

The Israeli startup, which is backed by $120 million in funding, today unveiled a chip called Gaudi (pictured) built for the sole purpose of training AI models.

That’s the part of the development lifecycle in which engineers hone their algorithms’ performance through repeated trial and error. An AI can take tens of millions of attempts to master a task, which means any technology that speeds up the process has the potential to pay big dividends.

Gaudi promises to provide major performance gains. To demonstrate its speed, Habana conducted an internal test that pitted the chip against Nvidia Corp.’s flagship V100 data center graphics card. The startup claims that Gaudi ran ResNet-50, a popular AI model commonly used for benchmarks, 3.8 times faster than the V100 and set a new industry performance record in the process.

It’s the second RestNet-50 record Habana has racked up in the past year. The startup achieved the previous one with Goya, its first chip, which is designed to power AI models that have already been trained and are used in production to process live data.

Gaudi shares a common design with Goya. They’re both comprised of eight processing cores based on a so-called very long instruction word architecture, which executes computations in parallel rather than one-by-one as a central processing unit does. What sets Gaudi apart is that it has different memory and throughout specifications better suited for AI training.

Habana will bring the chip to market in two forms: a PCIe card and a mezzanine accelerator designed to be loaded onto other, bigger cards. The startup has also developed a data center appliance called HLS that is loaded with eight mezzanine accelerators.

On top of providing fast processing speeds, Gaudi is also scalable. The mezzanine and PCIe cards feature eight and 10 built-in Ethernet ports, respectively, with each port supporting a 100-gigabit-per-second connection. That removes the need for companies to add in extra chips to handle networking, which will improve the efficiency of large-scale AI environments with a high number of Gaudi processors.

Habana plans to start sampling the chip later this year. The startup claims that its earlier Goya processor is already used by several customers, including cloud providers and autonomous vehicle firms. Habana also boasts big-name backers: Its most recent $75 million round was led by Intel Corp. with participation from Bessemer Venture Partners, Battery Ventures and others.

Image: Habana

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU