UPDATED 16:24 EDT / FEBRUARY 28 2024

AI

Google CEO Sundar Pichai calls inaccurate Gemini responses ‘unacceptable,’ promises fix

Google LLC Chief Executive Officer Sundar Pichai has told employees that the company will make “structural changes” to address the errors in Gemini’s image generation feature.

Pichai detailed the plan in an internal memo distributed late Tuesday, Semafor reported today. The executive also called the error, which caused Gemini to generate inaccurate images of racially diverse people, “completely unacceptable.” Google confirmed the memo.

Gemini is the new name of the Bard chatbot the company launched last year as a response to ChatGPT. Google changed the chatbot’s name on Feb. 8 following a series of feature updates that rolled out over the preceding days. One of those updates added an image generation tool, which is what laid the groundwork for the recent Gemini controversy.

Around a week ago, users of X began reporting that some of the images generated by the chatbot inaccurately depicted racially diverse characters in historical contexts. Google responded by temporarily disabling Gemini’s ability to generate images of people. Prabhakar Raghavan, the company’s senior vice president of knowledge and information, stated last Friday that the feature will be reactivated once the issue is fixed.

Pichai shared more details on the troubleshooting effort in the Tuesday memo to employees. “Our teams have been working around the clock to address these issues,” he wrote. “We’re already seeing a substantial improvement on a wide range of prompts.”

Citing sources familiar with the matter, Bloomberg reported today that Google only equipped Gemini with the ability to generate images of people after multiple internal reviews. Nevertheless, the search giant reportedly didn’t test “all the ways that the feature might deliver unexpected results.”

Pichai detailed that Google’s effort to address the issue won’t be limited to technical troubleshooting alone. He wrote in this week’s memo that the company intends to make “structural changes” as well as roll out “updated product guidelines, improved launch processes, robust evals” and other enhancements.

The effort is also set to place an emphasis on red teaming. That’s a practice whereby a company’s engineers attempt to find user output, such as chatbot prompts, with the potential to cause application malfunctions. Last July, Google disclosed that it has formed a team focused specifically on finding issues in its AI products.

Gemini is based on a large language model family of the same name that was developed by the search giant’s Google DeepMind unit. The unit also created the Imagen 2 model that powers the chatbot’s image generation features. Demis Hassabis, DeepMind’s CEO, disclosed on Monday Gemini’s ability to generate images of people could be reactivated within a few weeks.

Image: Google

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.