UPDATED 22:49 EST / NOVEMBER 19 2018

AI

Amazon has built an AI system that can train robots to speak like a newsreader

Amazon.com Inc. has come up with a new artificial intelligence system that can train digital voice assistants such as Alexa to learn new speaking styles, similar to a newsreader for example, in a matter of hours.

In a blog post today, Trevor Wood, Amazon’s applied science manager, said the new text-to-speech system could replace traditional methods of voice training that typically require actors to speak in the target style for tens of hours in order to train models.

“To users, synthetic speech produced by neural networks sounds much more natural than speech produced through concatenative methods, which string together short speech snippets stored in an audio database,” Wood wrote. “With the increased flexibility provided by [our system], we can easily vary the speaking style of synthesized speech.”

Amazon, which refers to its new model as “neural text-to-speech,” or NTTS, said there are two key components to it. One is a “generative neural network” that works by converting sequences of phonemes, which are distinct units of sound that distinguish one word from another, into sequences of spectrograms. Those, in turn, are a visual representation of the spectrum of frequencies of those sounds, since they vary over time. The spectrograms are said to “emphasize features that the human brain uses when processing speech,” Wood said.

The other component is known as a “vocoder,” which helps to convert those spectrograms into a continuous audio signal used to train the text-to-speech model.

The complex technical processes are detailed in Wood’s blog post, but the most important thing is that it seems to work just fine. The new training method can combine neural text-to-speech speech data with just a few hours of supplementary data to produce a model that can distinguish between elements of speech both unique to, and independent of, a particular speaking style.

Here’s an example of the older, concatenative method of speech:

And here’s an example of the neural text-to-speech trained voice in newsreader style:

“When presented with a speaking-style code during operation, the network predicts the prosodic pattern suitable for that style and applies it to a separately generated, style-agnostic representation,” Wood wrote. “The high quality achieved with relatively little additional training data allows for rapid expansion of speaking styles.”

Wood said Amazon’s research shows that listeners have a big preference for voices created by the neutral text-to-speech method over traditional concatenative synthesis. In fact, the NTTS method was rated almost as high as normal human speech itself:

ntts_bar_chart-png-_cb480028755_

“The preference for the neutral-style NTTS reflects the widely reported increase in general speech synthesis quality due to neural generative methods,” Wood said. “The further improvement for the NTTS newscaster voice reflects our system’s ability to capture a style relevant to the text.”

Amazon has published a series of whitepapers on its research, available here, here and here.

Photo: Stock Catalog/Flickr

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU