The rapid growth in unstructured information is transforming the entire enterprise IT stack, from the underlying infrastructure to the business software end users depend on to be productive. But while the journey to re-architect the data center is well under way, with the Hadoop distribution race already in full swing, the industry is only now beginning to deliver on the potential of Big Data applications, which Tresata CEO Abhi Mehta considers the next frontier of analytics.
“The value in the ecosystem sits really high up the stack, in what we call advanced analytics applications,” Mehta remarked in an interview on theCUBE last year. He predicts that within four years, the “massive race to zero in large parts of the historical data analytics stack where billions of dollars are currently being made” will shift spending to “the highest point of the stack in what we called analytics applications, predictive analytics software that works in Hadoop.” And Tresata isn’t the only vendor eyeing a slice of this rapidly emerging market.
A five-year-old startup called Concurrent is making big strides with Cascading, an open source Java framework that simplifies the development of data-driven apps on the batch processing platform. The firm claims that the software is downloaded more than 130,000 times a month and used by thousands of organizations, including Twitter, eBay and The Climate Corp.
Concurrent this week announced a complementary application performance management solution that aims to accelerate time to market and streamline maintenance for Cascading users. Branded as Driven, the cloud-based service provides visibility into data flows and program logic at runtime to enable test-driven development while allowing practitioners to keep tabs on information quality.
“The release of Driven further enables enterprise users to develop data oriented applications on Apache Hadoop in a more collaborative, streamlined fashion. Driven is the key to unlock enterprises’ ability to drive differentiation through data. There’s a lot more to come – this is only the beginning,” commented Chris Wensel, the founding CTO of Concurrent.