

The clash between old and new gripping the analytics world moved up yet another notch this morning with the release of a connector from Syncsort Inc. that aims to make it easier for organizations to tap records in their mainframes using Apache Spark. It’s being made available under the same open-source license as the data crunching engine.
The launch comes two months after IBM Corp., the leading producer of big iron, committed a cool billion dollars and some 3,500 engineers to accelerating the development of Spark. The two technologies represent two entirely different eras in data processing that have been in desperate need of bridging.
That’s because many of the mainframes still operating today are found in the financial sector, which is one of the leading adopters of modern analytics technologies such as Spark. In fact, one of the top use cases for the engine is finding anomalies in transactions, which often as not pass through an IBM system during processing.
The new connector will allow organizations to feed financial logs and other important data from their mainframes into Spark without the manual integration needed otherwise, saving time and effort. That information can then be integrated with other records to provide a broader view of operations.
But Spark is hardly the only tool in enterprises’ analytics arsenal, which is why Syncsort released a similar connector for Apache Sqoop, a likewise open-source technology meant to automate the migration of data from relational systems and Hadoop, last year. The pair will likely be joined by more integrations in the future as the company continues to work on simplifying the process of moving data out of aging mainframes.
Support our open free content by sharing and engaging with our content and community.
Where Technology Leaders Connect, Share Intelligence & Create Opportunities
SiliconANGLE Media is a recognized leader in digital media innovation serving innovative audiences and brands, bringing together cutting-edge technology, influential content, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — such as those established in Silicon Valley and the New York Stock Exchange (NYSE) — SiliconANGLE Media operates at the intersection of media, technology, and AI. .
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a powerful ecosystem of industry-leading digital media brands, with a reach of 15+ million elite tech professionals. The company’s new, proprietary theCUBE AI Video cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.