UPDATED 17:23 EDT / FEBRUARY 10 2025

INFRA

OpenAI reportedly finalizing design for in-house AI chip ahead of TSMC fabrication

OpenAI is reportedly getting closer to producing its own in-house artificial intelligence chip as it seeks to gain leverage over existing manufacturers and continues to expand its data centers.

According to sources referenced by Reuters, the company is in the final months of finalizing the design for the in-house chip, with plans for the chip to be sent for fabrication at Taiwan Semiconductor Manufacturing Co. Ltd. this year.  The report says OpenAI is aiming to have the chip in mass production by 2026.

Exactly what the OpenAI AI chip design will look like is unknown, but there have been previous reports, including in October that OpenAI was working with both Broadcom Inc. and TSMC on the chip. Previous suggestions have included that OpenAI is not looking to replace GPUs such as those provided by Nvidia Corp. but instead is looking to design a specialized chip that will undertake inference, the process of applying trained models to make predictions or decisions on new data in real-time applications.

Chips that support inference are needed as more tech companies use AI models to undertake more complex tasks. Currently, OpenAI relies heavily on Nvidia’s GPUs for training its models, a process that requires immense computational power to refine algorithms using vast datasets. However, inference requires different chip capabilities that are optimized for speed and energy efficiency rather than raw computational power.

While the technical idea behind the chip is solid, tech manufacturer politics is also seemingly playing a role in the development of the chip, with Reuters noting that the chip “is viewed as a strategic tool to strengthen OpenAI’s negotiating leverage with other chip suppliers.”

Those motivations aside, the exercise will not be a cheap one for OpenAI, even if it is a company where a $500 million investment — the estimated cost of designing the chip — is not much more than a rounding error. OpenAI has raised $17.9 billion to date, including a record-setting round of $6.6 billion in October. It was also reported in late January that OpenAI was seeking to raise a new round of $40 billion on a $340 billion valuation.

Image: SiliconANGLE/Ideogram

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.