UPDATED 15:51 EDT / FEBRUARY 08 2017

EMERGING TECH

Pinterest’s Lens app uses computer vision to find inspiration anywhere

Digital scrapbooking site Pinterest announced today that it is testing out a new app called Lens, an artificial-intelligence-powered camera app that lets users find pins based on the pictures they take.

While there are already a few apps that can help users identify objects, such as Google Goggles, Lens takes things a step further by recommending pins that are similar to what is in the picture. This allows users to search for ideas even if they do not know exactly how to word the search terms to find them.

“Just point Lens at a pair of shoes, then tap to see related styles or even ideas for what else to wear them with,” Evan Sharp, Pinterest Inc.’s co-founder and head of product, explained in a blog post. “Or try it on a table to find similar designs, and even other furniture from the same era. You can also use Lens with food. Just point it at broccoli or a pomegranate to see what recipes come up. Patterns and colors can also lead you in fun, interesting or even just plain weird new directions.”

Lens is currently in beta testing, and Sharp said that the app will be rolling out across the U.S. in the coming weeks. Pinterest did not explain the technology behind Lens, but this is not the company’s first foray into artificial intelligence.

Last month, Pinterest announced that it had revamped its related pin system using deep learning, giving users smarter suggestions for pins they might like based on their browsing history and pinboards. Using Google Inc.’s open-source TensorFlow machine learning library, Pinterest created its own deep learning agent called Pin2Vec, which compares pins in incredibly complicated ways.

In addition to Lens, Pinterest also announced two other new features today, both of which focus on content discovery. The first is a feature called Instant Ideas, which gives users easy access to related pins by simple clicking a circle on a pin they like. This instantly expands the page with related pins, which Sharp says is “like you’re instantly reshaping your feed around whatever catches your eye, all without losing your spot.”

The final feature announced today is Shop the Look, which adds rich data to pins that allows users to tap different objects in a picture to find similar items and where to buy them. For example, a user could click on the shirt or shoes a person is wearing in a picture and browse similar products that they can buy.

“Each of these new visual discovery tools takes that ah-ha moment you get when you come across a great idea, and turns it into more ideas—whether you’re on Pinterest or out exploring the world around you,” Sharp said.

Image courtesy of Pinterest

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU