Google LLC took to the stage at Mobile World Congress 2024 in Barcelona today to announce a new round of generative artificial intelligence features that will come to Android smartphones and wearable devices.

The updates include an AI boost for the Messages app, new features for Android Auto, the ability to access tickets and boarding passes via the Wear OS smartwatch and more.

Google said it’s making it possible for users to access its most advanced generative AI model, known as Gemini, directly within the Messages app on any Android phone. The new features, rolling out in beta testing this week, will enable users to draft messages, plan events, brainstorm ideas and get help with various other tasks directly within the Messages application.

In addition, Google said, it’s now ready to roll out its AI-powered image description tool globally. This affects the Lookout app on Android smartphones, which is used by people with poor vision to identify objects and documents.

The new generative AI capabilities within Lookout will enable the app to generate an audio description of whatever it’s looking at, such as photos online. The feature was first rolled out in beta in the U.S., the U.K. and Canada in September, and was limited to English language. It still only supports English for now, but it’s being made available globally with the promise of more languages to come.

Another AI-powered accessibility update is coming to the Lens feature within Google Maps. Lens relies on AI to identify restaurants, ATMs, transit stations, bus stops and other things in the user’s nearby surroundings. Now, Google’s TalkBack screen reader will be able to read out whatever information it Maps provides on a particular business, such as its opening hours, ratings and directions on how to get there.

Elsewhere, there’s an AI update coming to Docs that will allow users to add handwritten annotations to any document from a smartphone or tablet. So those who prefer to edit documents the old-fashioned way can simply use their finger or a stylus to scrawl directly onto the document, carrying out edits or highlighting information within it.

he Android Health Connect app can now access health data from Fitbit. Health Connect already pulls health information from various third-party apps and devices, such as AllTrails, Oura Ring and MyFitnessPal, and this update makes it a tad more useful.

Google’s vehicle operating system Android Auto is also getting some generative AI smarts with the ability to automatically summarize long texts and group chats while the driver is focused on driving. They’ll simply be able to listen to what’s being said while keeping their hands on the wheel. The new feature can also suggest quick replies, which can be sent with a quick tap, share an estimated time of arrival or start a call.

Last but not least, Google’s Wear OS is gaining the ability to access Google Wallet, where it can pull useful documents such as tickets, boarding passes and gym memberships and display them on any compatible smart watch. Additionally, Wear OS can now provide directions and public transit information thanks to its newfound support for Google Maps.

Images: Google