UPDATED 14:33 EDT / SEPTEMBER 01 2015

NEWS

Syncsort open-sources Spark connector for mainframes

The clash between old and new gripping the analytics world moved up yet another notch this morning with the release of a connector from Syncsort Inc. that aims to make it easier for organizations to tap records in their mainframes using Apache Spark. It’s being made available under the same open-source license as the data crunching engine.

The launch comes two months after IBM Corp., the leading producer of big iron, committed a cool billion dollars and some 3,500 engineers to accelerating the development of Spark. The two technologies represent two entirely different eras in data processing that have been in desperate need of bridging.

That’s because many of the mainframes still operating today are found in the financial sector, which is one of the leading adopters of modern analytics technologies such as Spark. In fact, one of the top use cases for the engine is finding anomalies in transactions, which often as not pass through an IBM system during processing.

The new connector will allow organizations to feed financial logs and other important data from their mainframes into Spark without the manual integration needed otherwise, saving time and effort. That information can then be integrated with other records to provide a broader view of operations.

But Spark is hardly the only tool in enterprises’ analytics arsenal, which is why Syncsort released a similar connector for Apache Sqoop, a likewise open-source technology meant to automate the migration of data from relational systems and Hadoop, last year. The pair will likely be joined by more integrations in the future as the company continues to work on simplifying the process of moving data out of aging mainframes.

Photo via IBM

Since you’re here …

… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.

If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.