The Internet of Things (IoT) is changing up the game of Big Data, and Pentaho Corp. is implementing changes to help the Big Data pipeline. Pentaho’s founder and CTO James Dixon sat down with George Gilbert and Dave Vellante, cohosts of theCUBE, from the SiliconANGLE Media team, at PentahoWorld 2015 to talk about Big Data and it’s incorporation into IoT.

The problem with old data systems

The problem with legacy systems, according to Dixon, is that they didn’t keep track of history.

“You can ask a CRM system, ‘How many customers do you have?’ and they can tell you immediately,” Dixon said. However, they couldn’t go back through history of how many many customers someone used to have or how many they’ve lost, etc. But with the idea of IoT and new devices, like the iPhone, that have data and a history attached to them, it’s changed everything.

Pentaho has been building new data systems that can work with that history.

3 main data sources

Dixon believes there are three main systems for helping with IoT.

“You’ve got the data lake for the history, you’ve got the real-time system for handling the streaming events, and you’ve got this state depository for knowing exactly how is each device right now,” he said. The challenge for Pentaho is to work with all three data sources, query them, join them together. It’s a very complex system, and that’s the current challenge.

Watch the full video interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of PentahoWorld 2015. And join in on the conversation by CrowdChatting with theCUBE hosts.

Photo by SiliconANGLE