UPDATED 17:30 EDT / APRIL 19 2018

BIG DATA

Enterprises like Netflix, ING embrace stream processing, real time

Large enterprises like Netflix Inc. and ING Inc. are just a couple use cases of businesses embracing a stream processing method that is both event driven, and in real time. This is the way modern companies, even those not traditionally labeled tech organization, will operate from now on as progressive, data-led technologies continue to scale.

“We see it in modern tech companies and traditional enterprises … a move toward a business that runs in real time, runs 24/7; is data driven, so decisions are based on data; and is software operated, so increasingly decisions are made by AI,” said Kostas Tzoumas, co-founder and chief executive officer of data Artisans GmbH.

Tzoumas spoke with George Gilbert (@ggilbert41), co-host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, at the Flink Forward event in San Francisco. They discussed how companies are implementing stream processing and real time through Apache Flink, an open-source stream processing framework developed by the Apache Software Foundation. (* Disclosure below.)

Enterprise use cases for stream processing, real time

Real-life companies are using process streaming in real time with larger and larger clusters and records per day. For example, Netflix has reported doing about about 1 trillion events per day on Apache Flink, a service data Artisans provides, according to Tzoumas. Netflix is powering its real-time recommendation updates, a variety of applications, and routing events internally using Flink.

“It’s really a variety of use cases,” Tzoumas said. “It’s really about building a platform internally and offering it to all sorts of departments in the company. Be that for recommendations, be that for BI, be that for running, state of microservices — you know, all sorts of things.”

Traditional companies are taking note, too, and changing with the current environment, Tzoumas noted. ING, a global customer bank based in the Netherlands, has a CEO who is now calling the company a tech company that has a banking license. They are no longer just a bank.

While tech companies like Netflix can more easily navigate concepts like stream processing, non-tech companies need more help. This where technologies experienced in Flink, like the data Artisans application platform, can come in handy. The data Artisans platform helps companies become more real time, modernize their IT infrastructure and get rid of legacy applications.

“What we have in the dA Platform is a notion of a deployment which is … a cluster, but it’s basically based on containers,” Tzoumas said. “So you have this notion of deployments that you can manage, and then you have a notion of an application. And an application is a Flink job that evolves over time.”

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of the Flink Forward 2018 event. (* Disclosure: TheCUBE is a paid media partner for Flink Forward 2018. Neither data Artisans GmbH, the event sponsor, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.