UPDATED 09:05 EDT / JUNE 15 2015

NEWS

What you missed in Big Data: Open-source power

The central role of the open-source movement in analytics rose back to the surface last week after LinkedIn Inc. released another one of its internally-developed data crunching technologies under a free license to help promote emerging use cases. And in particular, performing real-time business intelligence at the kind of scale where the traditional databases typically used for the task fall short.

Pinot, as the project is known, currently stores over 100 billion records  in support of more than 30 of the professional social network’s most important features, including the tracking capability that allows users to see who viewed their profiles and the analytic functionality provided to advertisers. That scalability could go a long way for organizations with needs likewise exceeding the capacity of existing options on the market.

But what makes Pinot not only appealing but also practical for the traditional enterprise is a relatively simple interface that allows users without specialized skills to interact with the data stored inside, the same pitch behind another open-source analytics project that made headlines last week. The difference is that Pachyderm is geared towards developers rather than business users.

The startup behind the software announced the completion of a $2 million seed round from Foundation Capital and a number of other-high profile investors on Thursday to help fuel the development of the free Hadoop implementation, which promises to simplify batch analytics. Pachyderm accomplishes that by automatically distributing workloads across preconfigured containers and adjusting the size of the cluster as needed from there.

That holds the potential to significantly lower the entry barrier to harnessing the power of the Hadoop for advanced use cases such as predictive analytics that have historically been beyond the reach of all but the most data savvy of organizations. Pachyderm shares that goal with Lattice Engines Inc.,  which raised $28 million in a funding round of its own last week for its proactive analytics software.

The platform scans for patterns in consumers’ activity to try and predict what products they’re likely to buy next, an approach that is finding success with PayPal Inc. and VMware Inc. and other big-name customers. The new capital will go towards developing new value-added to help marketers take even better advantage of that functionality.


A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.