Forging a pipeline for data integration | #BigDataNYC
If a company wants to put Big Data to work, they need to get the right information to the right people. Given the volume of data involved, this is not an easy task. A variety of tools have grown up to manage this data pipeline, bringing in data from the outside world and putting it together for analysis.
For a closer look at this part of the Big Data experience, Dave Vellante and George Gilbert, cohosts of theCUBE, from the SiliconANGLE Media team, met with Tendu Yogurtcu, general manager of Big Data with Syncsort, Inc., at the BigDataNYC 2015 conference.
Defining the data pipeline
Yogurtcu explained that Syncsort’s business was in offering a data integration product. This offering was optimized to run the pipeline through several different platforms. The purpose was make data available from various storage solutions and to prepare it for a company’s analytic tools.
She also mentioned how Syncsort contributed to open-source projects and used open-source APIs in its own products.
The challenge of development
Syncsort was also focused on improving its offerings. In particular, Yogurtcu said it was looking into the tools and technologies adopted by its customers. By watching the challenges its customers faced, the company could reduce the complexity of dealing with Big Data pipelines. They also planned to keep an eye on future use cases.
As for the challenges Syncsort confronted, its main concern was bringing different kinds of data together. Because data comes in so many forms, users had built up an arsenal of specific tools to deal with it. Syncsort’s goal is to simplify working with data and remove the need for so many tools.
In the coming years, the company wants to close the gap between the mainframe and open source. It also has plans to make life easier for organizations on the Big Data front. The company is presently innovating around these goals.
Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of BigDataNYC 2015.
Photo by SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Your vote of support is important to us and it helps us keep the content FREE.
One click below supports our mission to provide free, deep, and relevant content.
Join our community on YouTube
Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.
THANK YOU