UPDATED 17:30 EDT / APRIL 19 2018

BIG DATA

Enterprises like Netflix, ING embrace stream processing, real time

Large enterprises like Netflix Inc. and ING Inc. are just a couple use cases of businesses embracing a stream processing method that is both event driven, and in real time. This is the way modern companies, even those not traditionally labeled tech organization, will operate from now on as progressive, data-led technologies continue to scale.

“We see it in modern tech companies and traditional enterprises … a move toward a business that runs in real time, runs 24/7; is data driven, so decisions are based on data; and is software operated, so increasingly decisions are made by AI,” said Kostas Tzoumas, co-founder and chief executive officer of data Artisans GmbH.

Tzoumas spoke with George Gilbert (@ggilbert41), co-host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, at the Flink Forward event in San Francisco. They discussed how companies are implementing stream processing and real time through Apache Flink, an open-source stream processing framework developed by the Apache Software Foundation. (* Disclosure below.)

Enterprise use cases for stream processing, real time

Real-life companies are using process streaming in real time with larger and larger clusters and records per day. For example, Netflix has reported doing about about 1 trillion events per day on Apache Flink, a service data Artisans provides, according to Tzoumas. Netflix is powering its real-time recommendation updates, a variety of applications, and routing events internally using Flink.

“It’s really a variety of use cases,” Tzoumas said. “It’s really about building a platform internally and offering it to all sorts of departments in the company. Be that for recommendations, be that for BI, be that for running, state of microservices — you know, all sorts of things.”

Traditional companies are taking note, too, and changing with the current environment, Tzoumas noted. ING, a global customer bank based in the Netherlands, has a CEO who is now calling the company a tech company that has a banking license. They are no longer just a bank.

While tech companies like Netflix can more easily navigate concepts like stream processing, non-tech companies need more help. This where technologies experienced in Flink, like the data Artisans application platform, can come in handy. The data Artisans platform helps companies become more real time, modernize their IT infrastructure and get rid of legacy applications.

“What we have in the dA Platform is a notion of a deployment which is … a cluster, but it’s basically based on containers,” Tzoumas said. “So you have this notion of deployments that you can manage, and then you have a notion of an application. And an application is a Flink job that evolves over time.”

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of the Flink Forward 2018 event. (* Disclosure: TheCUBE is a paid media partner for Flink Forward 2018. Neither data Artisans GmbH, the event sponsor, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE

Since you’re here …

… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.

If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.