UPDATED 18:54 EDT / JANUARY 20 2021

AI

Facebook’s AI for the visually impaired gets more accurate

Facebook Inc. announced Tuesday an improved version of its artificial intelligence technology that generates descriptions of photos posted on its site for visually impaired users.

The Automatic Alternative Text AI was first introduced in 2016 as a way of improving the experience for visually impaired users. Before that, when a visually impaired user came across a photo on their newsfeed, Facebook would simply state the word “Photo” followed by the name of the person who posted it.

AAT improved that immeasurably by using AI to describe what the photos contain, and would typically state something like “image may contain: three people, smiling, outdoors.”

But the latest iteration of AAT is much more accurate and capable. With the update, Facebook has expanded the number of concepts it can detect and identify in an image, and also provide more detailed descriptions, covering activities, landmarks, food types and types of animals. So, for instance, it would be able to describe something like “a selfie of three people, laughing, outdoors, the U.S. Capitol,” instead of just saying “three people, smiling, outdoors.”

Facebook said the updated AAT can now recognize about 1,200 concepts instead of just 100. It achieved that by training the AI on a weekly basis using samples that Facebook said were “more accurate, culturally and demographically inclusive.”

The company added that it trained the models to predict locations and semantic labels of the objects within an image. Multilabel and multidataset training techniques also helped make the model more reliable.

Users also have the option to click on an image and get an even more detailed description of what it contains.

Detailed descriptions also include simple positional information such as top/middle/bottom or left/center/right, as well as a comparison of the relative prominence of objects.

Images: Facebook

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU