BIG DATA
BIG DATA
BIG DATA
Hortonworks co-founder outlines edge strategy and standards initiative for big data
In February, Hortonworks Inc. announced general availability of DataFlow 3.1, the company’s data-in-motion platform for edge and streaming analytics. The release provided further evidence that Hortonworks intends to include edge computing in its competitive strategy for the Apache Hadoop market.
“That certainly has to be a part of our strategy because it is part of what our customers are doing,” said Alan Gates (pictured), co-founder of Hortonworks. “Our goal is to help our customers with their data wherever it is.”
Gates spoke with James Kobielus (@jameskobielus), host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, at the DataWorks Summit EU in Berlin, Germany. They discussed the role of Apache Nifi and Kafka in the streaming strategy and Hortonworks’ involvement in a big data standards initiative. (* Disclosure below.)
Focused on data in motion
Hortonworks DataFlow is an integrated solution with Apache Nifi and Apache Kafka, both of which can be focused on data in motion. “Nifi is really focused on that data at the edge,” Gates explained. “You need to figure out what parts of the data to move upstream, what parts not to.”
Kafka will likely continue to run in data centers, according to the Hortonworks co-founder, playing more of a role to monitor the information coming in via Nifi. “It’s still a pretty heavyweight technology in terms of memory,” Gates said.
Hortonworks had been committed for several years to the Open Data Platform initiative, or ODPi. The nonprofit organization was formed to simplify and standardize the big data ecosystem. Gates manages the technical relationship with ODPi.
“We do want to build it around Apache Atlas,” Gates said. “We want to do it in an open way so [customers] can still plug in their data repositories and communicate with others.”
Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of the DataWorks Summit EU. (* Disclosure: Hortonworks Inc. sponsored this segment of theCUBE. Neither Hortonworks nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
Photo: SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
