UPDATED 14:16 EDT / MARCH 23 2018


New DeepMind research applies ‘neuron deletion’ to improve AI models

Artificial intelligence algorithms are highly sophisticated constructs that can contain an eye-watering number of neurons and internal connections. This gives them the power to handle a wide range of complex tasks, but also makes it tricky for researchers to understand the way conclusions are made and how the process can be improved.

On Wednesday, Alphabet Inc.’s DeepMind deep learning group detailed a new method that says can help clear up the picture.

The key to the technique is an approach called neuron deletion. As part of its research, DeepMind created several image classification models and removed some of their artificial neurons in a targeted manner. The group’s AI experts then measured how the changes affected processing.

The technique can provide insight into the inner workings of the individual neurons in an AI. According to the group, researchers have until now succeed in thoroughly analyzing only “selective neurons” configured to process a specific type of input, which constitute a small part of a typical neural network. Visibility of the other nodes makes it possible to piece together a much more complete picture.

DeepMind analyzed the impact of deleting neurons on its test AI algorithms. The Alphabet subsidiary found that there’s a correlation between how well a model withstands the changes and its ability to “generalize,” or perform calculations without any workarounds. This enables researchers to find structural problems within their models that may undermine the accuracy of results.

Researchers said that technique should be particularly handy for finding cases where an AI “cheats” using the sample data it was trained with. This phenomenon, which the group codiscovered last year with Google Brain and the University of California at Berkeley, essentially involves an algorithm memorizing the training records and using them as a sort of cheat sheet. 

The testing method was inspired by techniques employed in the field of neuroscience. Another area that the group has drawn upon to help further its AI research is psychology. Two months ago, DeepMind open-sourced a cognitive assessment tool that lets AI researchers create a controlled virtual environment for evaluating their models.  

Image: Unsplash

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy