UPDATED 08:20 EST / NOVEMBER 30 2015

NEWS

What you missed in Big Data: Scaling analytics

The analytics ecosystem grew a little bigger last week with the launch of a new open-source project from IBM Corp. that aims to help simplify the development of machine learning models for data crunching applications. The aptly-named SystemML framework is a product of the company’s work on Watson that abstracts away many of the complicated implementation details involved in building a production-grade algorithm to let analysts focus their energy on creating new features instead.  

A user only needs to write their code in their preferred language, whether it’s R or the less specalized Python, and trust SystemML to do the rest. The framework automatically determines the fastest way to execute an algorithm based on the characteristics of the hardware on which it’s running in order to spare data scientists the hassle of manually optimizing their machine learning logic, thus removing one of the most time-consuming chores in the entire development process. But there are still many more operational obstacles to performing large-scale data analytics left on the checklist that aren’t nearly as easily addressed.

The challenge is arguably most pronounced in the storage layer, where the need to economically retain the massive amounts of data entering the corporate network has to be balanced with the requirement for high-speed access, which has traditionally come at a significant cost. An Israeli stealth startup called Iguaz.io Ltd. raised $15 million from a group of top local venture capital firms led by Magma Venture Partners to tackle the issue with its upcoming software-defined data management solution, which promises to “address the unique challenges” of large-scale analytics.

The investment came against the backdrop a second Israeli startup announcing a funding round of its own to address the other major challenge of handling the rapidly-growing data troves in the enterprise: Protecting it from hackers. Fortscale Security Ltd. has developed a service that uses machine learning to understand the normal behavior of an organization’s workforce and use that insight to detect malicious activity on an automated basis. The new $4 million in financing from futures trading giant CME Group Inc and UST Global Inc. will help strength that value proposition even further.

Image via Geralt

Since you’re here …

… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.

If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.