UPDATED 15:32 EDT / DECEMBER 07 2018

AI

DeepMind ‘closes chapter’ in AI research with new self-learning AlphaZero system

A system developed by Alphabet Inc.’s DeepMind subsidiary has mastered three of the world’s most complex board games in an achievement hailed as a milestone for artificial intelligence research.

The group detailed the system, which it calls AlphaZero, in a paper released today. The software is the third major evolution of AlphaGo, the AI that made headlines last year after beating the world champion in Go.

AlphaGo took months to train and relied heavily on human input to master the notoriously difficult game. The second iteration, the first to bear the AlphaZero name, managed to surpass its predecessor’s skill level after a mere 30 hours by harnessing a new learning method. DeepMind’s latest system has successfully applied the same method to chess and the closely related Japanese game of shogi.

AlphaZero shares little in common with traditional game engines such as Deep Blue, the computer that famously defeated former world chess champion Garry Kasparov in 1986. Whereas traditional engines rely on information from human players, DeepMind’s system learned to play all on its own. The group’s researchers supplied the AI with nothing more than the rules of the three games it was built to master.

DeepMind explained in a blog post that “to learn each game, an untrained neural network plays millions of games against itself via a process of trial and error called reinforcement learning. At first, it plays completely randomly, but over time the system learns from wins, losses, and draws to adjust the parameters of the neural network, making it more likely to choose advantageous moves in the future.”

AlphaZero has proved to be far more powerful than existing AI game engines. The system beat the previous record-holder in chess, Stockfish, after a mere four hours of training and took half that time to surpass the leading Elmo shogi engine.

1

The fact that AlphaZero managed to learn three separate board games, each with its own distinct set of rules, demonstrates an unprecedented level of versatility for an AI. According to DeepMind, it shows that the system may be capable of mastering any perfect information game. This category encompasses Chess, Go and other games that have so far been at the center of AI scientists’ research efforts.

“This work has, in effect, closed a multi-decade chapter in AI research,” Murray Campbell, an AI research at IBM Corp. who helped develop the Deep Blue computer, wrote in an editorial that accompanied the AlphaZero paper. “AI researchers need to look to a new generation of games to provide the next set of challenges.”

This achievement represents another step toward the holy grail of AI: artificial general intelligence, or software with the ability to solve problems across different domains as well as a human.

DeepMind’s research is part of its long-term goal of harnessing AI to facilitate new advances in fields such as healthcare. But although the potential upside is significant, so are the risks.

Concerns are mounting in the tech industry about the possibility of advanced AI technology being misused for unethical purposes. As it happens, the newest and one of the highest-profile calls for regulation so far came just this morning, against the backdrop of DeepMind releasing its AlphaZero paper.

Microsoft Corp., another major player in the AI arms race, announced that it will adopt ethical principles to guide its use of its facial recognition software. The company also urged governments to implement policies for preventing abuse of the technology. Microsoft President and Chief Legal Officer Brad Smith warned in the announcement that “the facial recognition genie, so to speak, is just emerging from the bottle.”

Photo: DeepMind

A message from John Furrier, co-founder of SiliconANGLE:

Support our open free content by sharing and engaging with our content and community.

Join theCUBE Alumni Trust Network

Where Technology Leaders Connect, Share Intelligence & Create Opportunities

11.4k+  
CUBE Alumni Network
C-level and Technical
Domain Experts
15M+ 
theCUBE
Viewers
Connect with 11,413+ industry leaders from our network of tech and business leaders forming a unique trusted network effect.

SiliconANGLE Media is a recognized leader in digital media innovation serving innovative audiences and brands, bringing together cutting-edge technology, influential content, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — such as those established in Silicon Valley and the New York Stock Exchange (NYSE) — SiliconANGLE Media operates at the intersection of media, technology, and AI. .

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a powerful ecosystem of industry-leading digital media brands, with a reach of 15+ million elite tech professionals. The company’s new, proprietary theCUBE AI Video cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.