UPDATED 04:15 EDT / OCTOBER 16 2018

card catalog BIG DATA

With fall release, Talend jumps into data cataloging and API development

Data integration company Talend SA is expanding its scope into data cataloging and application program interface development with the fall update to its Talend Data Fabric integration platform announced today.

Both markets are growing quickly as organizations seek to get a better handle on the data they already have and expose it through APIs. The global data catalog market is expected to reach nearly $1.6 billion in revenue in 2026 from $200 million today, a compound annual growth rate of nearly 26 percent, according to Research and Markets Ltd. Programmable Web Inc.’s directory of public APIs has grown to more than 20,000 entries from about 5,000 in 2012.

Talend’s new data catalog automatically crawls data in data lakes, on-premises infrastructure and the cloud, then profiles and classifies it, automatically finding and suggesting relationships between data. It then provides search-based access for quick retrieval. About 80 percent of data definitions can be determined automatically, said Jean-Michel Franco, director of product marketing for Talend’s data governance products.

The move pits Talend against a number of established and startup vendors in a crowded data catalog market that includes IBM Corp., Alation Inc., Collibra NV and Waterline Data Inc. Franco said the strength of Talend’s approach is its data management and governance capabilities.

“We have strong stewardship capabilities on the back end that includes the ability to make data more understandable,” he said. One of Talend’s differentiation points is its ability to combine data catalog capabilities with data quality management, he added. “This fills a gap that standalone data catalog solutions fail to address.”

The API development platform is the product of Talend’s acquisition last year of Restlet Inc., maker of a cloud-based API design and testing system. Rebranded Talend Cloud API Services, the software provides full development lifecycle support for API design, test and deployment. APIs are commonly used by organizations to expose data and program functionality to other applications. For example, many weather services use APIs to enable applications such as calendars to incorporate weather data.

“We’re putting in place tools for testing, industrialization and operation of APIs at scale,” said Nicholas Piette, director of product marketing for API services at Talend. The platform will be compatible with standards such as the OpenAPI Initiative to enable interoperability with API management platforms such as Google LLC’s Apigee.

Developers will be able to use graphical tools to design APIs and test them in real-world scenarios. The platform includes a service implementation layer for deployment in Talend’s cloud platform. APIs can be deployed as native services or wrapped into containers.

“Talend’s key strength is turning datasets and derived information and insights into API-based data assets,” Piette said. The new services “enable large teams of developers to collaborate on the required mediation and orchestration.”

The fall release will also include serverless big-data support for Microsoft Corp.’s Azure Databricks Apache Spark-based analytics service and Qubole Inc.’s big-data service on the Amazon Web Services Inc. cloud. The Azure Databricks integration makes it possible for users to spin up a cluster and pay only for what is used through serverless and spot instances, the company said.

The update will be available in November at no additional cost to customers with current paid subscriptions.

Image: Flickr CCK/h5>

Since you’re here …

Show your support for our mission with our one-click subscription to our YouTube channel (below). The more subscribers we have, the more YouTube will suggest relevant enterprise and emerging technology content to you. Thanks!

Support our mission:    >>>>>>  SUBSCRIBE NOW >>>>>>  to our YouTube channel.

… We’d also like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.

If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.