Security. Accessibility. Compliance. The demands of data management are becoming more complex, while, simultaneously, the amount of data to manage is increasing. Since the start of the digital revolution, the amount of raw information flowing into the so-called ‘data lakes’ has increased from a trickle, to a flow, to a deluge.

“In today’s age, the data is coming at you in a velocity that you never thought about. … Organizations are gathering data in the magnitude of petabytes, and this is a new normal,” said Vimal Endiran (pictured), senior manager, Accenture Analytics, at Accenture PLC. “[But] even though it’s coming at that volume and velocity doesn’t mean it’s useful.”

Endiran spoke with Rebecca Knight (@knightrm) and James Kobielus (@jameskobielus), co-hosts of theCUBE, SiliconANGLE Media’s mobile livestreaming studio, during the DataWorks Summit in San Jose, California. They discussed the challenges businesses face in managing big data and how the Accenture and Hortonworks Inc. partnership helps businesses with data asset management. (* Disclosure below.)

Pre-built models give ‘citizen data scientists’ command of data analysis

Accenture and Hortonworks have over four years of collaboration history helping companies manage. secure and monetize their data inflow. As businesses move to cloud-based and hybrid storage, a demand for more flexible offerings has surfaced, according to Endiran.

“We have developed offerings called modern data warehouse, taking advantage of [existing] legacy systems — plus this new data coming together — and immediately you can create analytics cases, use cases … ,” Endiran said.

‘Citizen data scientist’ is a contentious term in modern data science, with some in the industry seeing it as demeaning the expertise of actual data scientists. Endiran has a different point of view, seeing it as democratizing data science by allowing more open access to the benefits of data analysis through the use of pre-built models.

“I become a data scientist by using a pre-defined model developed by many experts together,” said Endiran, speaking from the point of view of a business end-user. “My job is not creating a model. … I want to get the outcome [so that] I can increase my profit [and] increase my sales. I may become a citizen data scientist without knowing. I won’t even be told that I’m using a model. I will take this set of data, feed it in here, [and] it’s going to tell you something,” he explained.

Solving compliance issues brought about by the requirements of the General Data Protection Regulation — which affects any business with European operations — is the latest offering from the Hortonworks-Accenture alliance. Under the new GDPR rules, fines for non-compliance with personal information removal requests from clients can be up to four percent of a company’s [revenue], so the ability to easily find, delete or modify personal data is critical. Announced during the DataWorks Summit, the new tool gives companies the ability to scan stored data, tracking where every piece of information is stored across multiple locations.

“I exactly know [the client’s data] is in this place, in this table, or this column … and take it out from there so that [the client] doesn’t exist anymore. … We can catalog the entire data lake and know not just personal information, [but] other useful information and everything about all the dimensions as well, and we can use it for business advantage,” Endiran concluded.

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s coverage of the DataWorks Summit. (* Disclosure: Hortonworks Inc. sponsored this segment of theCUBE. Neither Hortonworks nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE