UPDATED 08:30 EDT / SEPTEMBER 21 2015

NEWS

What you missed in Big Data: Unlocking the potential of Hadoop

The industry effort to make Hadoop more viable for everyday enterprises gained a surprising new supporter last week in Pinterest Inc., which released an internally-developed tool that helps make insights produced in the framework accessible to other applications. Its entry into the fray adds another name to the already lengthy list of web companies involved in the project.

Hadoop started its life at Yahoo! Inc. as an implementation of the MapReduce data processing model developed by Google Inc. in 2004 and has since seen its capabilities augmented with additions from a number of other online giants. Pinterest’s new technology, aptly called Terrapin, combines several of those latter contributions to provide low-latency access to terabyte-sized datasets from the framework.

Achieving that previously required complicated workarounds that proved far too inefficient for its purposes, not too mention taxing on the engineering team, a challenge that is compounded severalfold for the majority of organizations that don’t have access to talent of the same caliber. Making it easier to export files from Hadoop thus allows Terrapin to significantly lower the entry barrier to the project.

But there are still numerous issues standing in the way of the platform from reaching its full adoption potential, first and foremost the difficulty of producing the insights that Pinterest’s tool is designed to help make more accessible. That issue also received some much-needed attention last week after Arcadia Data Inc. launched a commercial version of its Hadoop-based business intelligence solution.

Arcadia Enterprise provides a visual analytics workbench that makes it possible to create visualizations from information stored in their organizations’ analytics clusters using a drag-and-drop builder that doesn’t require any knowledge of the underlying cogwork. That expands the accessibility of platform beyond data scientists to everyday business users.

For all the focus on Hadoop, however, it’s hardly the only tool in an organization’s analytics arsenal. The growing amounts of data coming from new sources such as connected devices is also driving enterprises to adopt solutions like Iron.io Inc.’s namesake event processing service, which netted its creator $8 million in funding against the backdrop of Arcadia’s launch.

The capital will help add more capabilities to its offering, an alternative to the Lambda engine that Amazon Inc. added to its cloud platform last year with the same value proposition. Developers can use Iron.io’s technology to automatically execute algorithms against incoming real-time data and feed the results into their applications for use cases such as alert delivery and traffic monitoring.

Photo via Yolanda

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU