Is this the perfect recipe for data streaming, integration and analysis?
Raw data can be compared with the raw ingredients for a gourmet dish. The potential is there, but it needs to be prepared correctly before being served up for consumption. Creating a successful platform for streaming integration analytics takes more than than stuffing things in and taking things out. And just as many chefs shout that their signature dish is the greatest, many technology providers advertise that they have the perfect end-to-end data streaming solution. But what does true end-to-end service look like?
“When you are thinking about doing streaming integration, it’s more than just moving data around,” said Steve Wilkes, (pictured) founder and chief technical officer of Striim Inc. “[You] can’t just give people streaming data; [you] need to give them the ability to process that data, analyze it, visualize it, play with it, and really truly understand the data.”
Wilkes spoke with Dave Vellante (@dvellante), host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, at the BigData SV event in San Jose, California. They discussed Striim’s real-time data integration and streaming analytics platform, as well as what makes it a complete end-to-end solution.
From data collection to dashboard visualization
“The first part of being able to do streaming data integration or analytics is that you need to be able to collect the data,” Wilkes said. The Striim platform has wizards to help build data flows and create streams SQL-based processing for filtering, transformation, aggregation, and enrichment of data, as well as a cache component to load reference data into memory.
Apache Kafka open-source stream processing software comes built into Striim, and target adapters allow write-out to cloud storage, such as Amazon Redshift or Azure Blob Storage. Ready to analyze the data?
“So you take the data stream, you build another data flow that is doing some aggregation of windows, maybe some complex event processing, and then use that dashboard builder to build a dashboard to visualize all of that,” Wilkes concluded.
Watch the complete video interview with Wilkes below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of the BigData SV event.
Photo: SiliconANGLE
Since you’re here …
… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.
If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.