UPDATED 18:45 EDT / JUNE 14 2017

murthy BIG DATA

Drowning in the data lake, companies seek out predictive analytics tools

Whether it’s shopping for a pair of shoes or running a large multi-tier data center, everyone is looking for value. The increasing complexity involved in managing the vast store of raw data, the data lake, has information technology executives looking for tools that can perform predictive analytics accurately and rapidly while making a real contribution to the bottom line.

“One of the best ways to get value out of the data is this notion of predicting what is going to happen in your world, with your customers and with the data you already have,” said Arun Murthy (pictured), founder and vice president of engineering at Hortonworks Inc.

Murthy visited theCUBE, SiliconANGLE’s mobile live-streaming studio, and answered questions from hosts Lisa Martin (@Luccazara) and George Gilbert (@ggilbert41) during DataWorks Summit in San Jose, California. They discussed how clients who are using Hortonworks are able to meet data management challenges and add value at the same time. (* Disclosure below.)

Client adds 30 percent throughput to cluster

Murthy described the experience of one large, unnamed financial services client who had hundreds of thousands of machines running on the Hortonworks Data Platform. The company used SmartSense, a proactive Hadoop-based monitoring service, to identify 25 machines with bad configurations. The result: The company added 30 percent throughput back on their cluster.

“At that scale, it’s a lot of money,” said Murthy.

There is also increasing interest in using tools like Apache Atlas to create a scalable, open framework for data governance. Murthy cited an example where Hortonworks has been working with partner IBM Corp. to help clients in Europe meet the requirements of the General Data Protection Regulation, a set of mandatory data protection standards that will go into effect in 2018.

“If you are not compliant by March of next year, you pay a portion of your revenue as fines,” Murthy said. “It’s a really big deal.”

Although Hortonworks was founded in 2011, Murthy has been working with Hadoop for longer.

“People have been looking for folks with 10 years of experience on Hadoop, and I’m here finally,” he said. “It’s been an amazing journey.”

Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s independent editorial coverage of DataWorks Summit. (* Disclosure: Hortonworks Inc. sponsored this DataWorks Summit segment on SiliconANGLE Media’s theCUBE. Neither Hortonworks nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

Photo: SiliconANGLE

Since you’re here …

Show your support for our mission with our one-click subscription to our YouTube channel (below). The more subscribers we have, the more YouTube will suggest relevant enterprise and emerging technology content to you. Thanks!

Support our mission:    >>>>>>  SUBSCRIBE NOW >>>>>>  to our YouTube channel.

… We’d also like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.

If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.