UPDATED 16:16 EDT / SEPTEMBER 24 2020

AI

Amazon builds custom AZ1 ‘neural edge’ processor into its new Echo speaker

Amazon.com Inc. today debuted a new iteration of its bestselling Echo smart speaker with a custom-made artificial intelligence processor for processing voice commands.

The Echo is the flagship device in Amazon’s eponymous family of smart speakers. Since introducing the product line in 2014, the company is estimated to have sold tens of millions of devices worldwide, making it the largest player by market share. 

The AI processor in the new Echo model is called the AZ1 Neural Edge and was developed as part of a collaboration with semiconductor maker MediaTek Inc., Amazon executives said today. It will enable the Echo to answer user questions faster by processing voice commands locally. Earlier smart speakers had to send voice commands to the cloud for processing and then wait until the results came back, which delayed Alexa responses.

In practice, Amazon claims, the addition of the AZ1 will lead to a speedup of hundreds of milliseconds per response, which is noticeable by users.

The company’s engineers made big design improvements under the hood to facilitate the performance boost. The AZ1 is described as capable of providing double the performance of Amazon’s previous-generation silicon for speech processing tasks using 20 times less power. Moreover, it has 85% lower memory usage, which further contributes to hardware efficiency.

Amazon can potentially harness the Echo’s new ability to process voice commands locally to provide improved support for offline use. Since requests don’t have to be sent to the cloud for the processing, the AZ1 processor could theoretically allow smart speakers to function even in environments with spotty or no connectivity. 

In the future, Amazon may also have an incentive to add the AZ1 to more Echo devices. Offline voice command processing could be a powerful addition to Echo devices designed for on-the-go and outdoors use such as the Echo Auto, which don’t always have access to a steady wireless connection.

The broad consumer adoption of voice assistants has also led other consumer device makers besides Amazon to prioritize AI speech processing hardware. Google LLC’s latest Pixel 4 smartphone, for example, packs a chip called the Neural Core that can run voice recognition algorithms locally. Apple Inc., in turn, recently debuted a new iPad Air with an AI module twice as fast the module inside the previous version of the tablet. 

Further up the supply chain, several chip startups have emerged to capitalize on the demand for speech processing silicon. One player called Syntiant Inc. recently raised $35 million for a chip it says is 100 times more power-efficient than rivals’.

Image: Amazon

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU