UPDATED 14:56 EDT / JUNE 21 2012

NEWS

Be Not Afraid, But Big Data Analytics is a Game of Risk

The definition of insanity, so said Albert Einstein, is doing the same thing over and over again and expecting different results. That applies to life, love and, yes, Big Data Analytics.

Think about it. If you put a Toyota Camry engine in a Ferrari and expected it to perform like a Ferrari should, you’d be sorely disappointed. You’d be insane, however, if you tried the car again and again, day after day, expecting one day to hit zero-to-sixty in six seconds.

But that’s just what Michele Chambers sees customers attempting in pursuit of Big Data Analytics. Chambers, GM and VP of IBM’s analytics solutions division, said many of her customers buy into the promise of Big Data and predictive analytics, but want to achieve it with the same old business intelligence and database tools they’re comfortable with.

“Typically what [customers] do is they go back and lean on what they already know,” said Chambers in an appearance on theCUBE at Hadoop Summit 2012 (video at bottom of post.) “They want to use their existing infrastructure, they want to use their existing data, they want to use their existing tools. They don’t want to do anything different. And I say if you don’t do anything different, you’re not going to get any different results.”

New Approaches, Technologies and Tools Required

Chambers is exactly right, on all three fronts, and here’s why:

  1. Infrastructure. New methods of processing and storing large, multi-structured data sets are emerging precisely because traditional relational technology cannot do the job in a time- or cost-effective way. Hadoop, for example, allows you to store and process Big Data at scale in a reasonable timeframe on cheap commodity boxes running open source software. Now try doing that with Oracle. I’ll check back with you $3 million and six months from now.
  2. Data. Big Data is about enriching your existing internal transactional data with additional data from diverse sources, some of those sources from outside of your enterprise. That could mean social media data from Twitter or Facebook, public sector data from the National Weather Service or Department of Education, or market data from Bloomberg or Dow Jones. If you’re not mashing up data, you’re probably not doing Big Data Analytics.
  3. Tools. Because they must operate on new, larger, more diverse data volumes on top of parallel computing infrastructure, most traditional business intelligence tools aren’t going to cut it either. What you need are modern data visualization and analytic platforms that allow users to easily manipulate and visualize Big Data. To be fair, a handful of existing BI vendors like Tableau and Microstrategy are working hard to allow their products to better integrate with Big Data. But by and large, that old reporting tool you’ve been using for the last decade or so isn’t going to be enough to deliver actionable insights from Big Data.

A Game of Risk

But I understand that change is hard, even more so inside sometimes risk-averse IT departments. But we’re at a crossroads. Big Data isn’t just a passing fad or a marginally better way to do business intelligence. It’s a completely new paradigm that requires a major shift in thinking. In other words, “You’ve got to take some additional risk,” as Chambers puts it, to achieve Big Data success.

That means, she said, “You’ve got to infuse your applications, you’ve got to infuse your data with net new information if you want to have additional insights.” That means you’ve got to invest in new infrastructure technologies such as Hadoop and other platforms to form a new foundation for Big Data Analytics. And you’ve got to take a chance on new end-user tools that can turn all that Big Data into easy-to-understand insights.

The good news is you don’t have to rip-and-replace your entire existing infrastructure and tools set. In fact, I would strongly advise against that. What you’re using now for business intelligence and data warehousing is likely (hopefully) there for a reason, that being because they are delivering value to the business. And in fact, many Big Data technologies can actually help you derive more value from existing databases and tools.

When it comes to Big Data, start small. Identify a specific business problem that you want to solve, one that if fixed would result in tangible benefits to the business. Talk to peers that have already jumped headfirst into Big Data to learn from their experiences. Educate yourself. Read everything and anything Big Data related you can get your hands on.

And then you have to take a risk. Evaluate and invest in some new Big Data technologies and services that will allow you to tackle your chosen business problem and attack it with abandon. And don’t be scared. Change is hard, but the rewards are Big. Big Data Big.

IBM Stepping Up Its Game

On a side note, I want to give credit to IBM for stepping up its Big Data game. A few months back I criticized Big Blue for not providing enough leadership in the Big Data space. Specifically, I said the company needed to talk less about its myriad analytics and database products and talk more about their vision of what Big Data could be for the enterprise and how we’re all going to get there. And that’s precisely what it’s done, Michele Chambers being but one good example. Let’s hope IBM keeps it up.

 


A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU