UPDATED 04:46 EDT / APRIL 01 2013

The 3 New Buckets of the Real-Time Big Data Stack : Query, Insight + Action

What’s the intersection between the Big Data stack and real-time capabilities? The convergence is long overdue, says Trestata founder Abhishek Mehta, who discusses the market juncture on a recent NewsDesk segment (full video below).

Mehta first describes how real-time analytics gradually transformed from a nice-to-have to a must-have in the past 12 months.

“The capabilities you need in analytics to solve some business problems need real time ability, as well as real time capabilities to not just query and play with the insight, but also find answers to some topics,” Mehta says.  “Real-time and its interception with Big Data is a must-have technology piece in any Big Data stack you may choose to adopt.”

The need for real-time analytics brings up a new question: what exactly constitutes real-time? Mehta calls this “the multi-billion dollar question,” and answers it by saying that the definition depends on the specific business problem that you’re trying to address.

On one hand, a high-frequency trading algorithm that processes transactions in real-time has to maintain sub-millisecond performance in order to live up to its name. On the other, an application that fulfills a different role might operate in 24-hour cycles and still carry out its task just as efficiently as the former solution.  In the context of data analytics, real-time describes the ability to deliver results as fast as possible.

Mehta goes on to say that the new Big Data stack can be divided into three distinct buckets: real-time query, real-time insight, and real-time action.  The first category has received a lot of attention recently thanks to the launch of Greenplum’s HAWQ, Taze and Impala, but it’s the latter two buckets that got Mehta interested. Open-source platforms such as Project Spark and Twitter’s Storm are disrupting the way in which insights can be extracted and translated into value.


A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU