UPDATED 17:30 EST / APRIL 19 2018

BIG DATA

Enterprises like Netflix, ING embrace stream processing, real time

Large enterprises like Netflix Inc. and ING Inc. are just a couple use cases of businesses embracing a stream processing method that is both event driven, and in real time. This is the way modern companies, even those not traditionally labeled tech organization, will operate from now on as progressive, data-led technologies continue to scale.

“We see it in modern tech companies and traditional enterprises … a move toward a business that runs in real time, runs 24/7; is data driven, so decisions are based on data; and is software operated, so increasingly decisions are made by AI,” said Kostas Tzoumas, co-founder and chief executive officer of data Artisans GmbH.

Tzoumas spoke with George Gilbert (@ggilbert41), co-host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, at the Flink Forward event in San Francisco. They discussed how companies are implementing stream processing and real time through Apache Flink, an open-source stream processing framework developed by the Apache Software Foundation. (* Disclosure below.)

Enterprise use cases for stream processing, real time

Real-life companies are using process streaming in real time with larger and larger clusters and records per day. For example, Netflix has reported doing about about 1 trillion events per day on Apache Flink, a service data Artisans provides, according to Tzoumas. Netflix is powering its real-time recommendation updates, a variety of applications, and routing events internally using Flink.

“It’s really a variety of use cases,” Tzoumas said. “It’s really about building a platform internally and offering it to all sorts of departments in the company. Be that for recommendations, be that for BI, be that for running, state of microservices — you know, all sorts of things.”

Traditional companies are taking note, too, and changing with the current environment, Tzoumas noted. ING, a global customer bank based in the Netherlands, has a CEO who is now calling the company a tech company that has a banking license. They are no longer just a bank.

While tech companies like Netflix can more easily navigate concepts like stream processing, non-tech companies need more help. This where technologies experienced in Flink, like the data Artisans application platform, can come in handy. The data Artisans platform helps companies become more real time, modernize their IT infrastructure and get rid of legacy applications.

“What we have in the dA Platform is a notion of a deployment which is … a cluster, but it’s basically based on containers,” Tzoumas said. “So you have this notion of deployments that you can manage, and then you have a notion of an application. And an application is a Flink job that evolves over time.”

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of the Flink Forward 2018 event. (* Disclosure: TheCUBE is a paid media partner for Flink Forward 2018. Neither data Artisans GmbH, the event sponsor, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU