UPDATED 18:10 EDT / AUGUST 06 2013

The History and Future of Data Architecture Models #HPBigData2013

Updated with full video – see below.

SiliconANGLE’s TheCUBE, broadcasting live from the HP Big Data Conference in Boston welcomed Brian Dougherty to discuss the future of data warehouse architecture. Dave Vellante of Wikibon and founder of SiliconANGLE, John Furrier, spoke with Dougherty just as the keynote presentation by Major League Baseball player Billy Bean was being completed.

Dougherty, the Chief Data Warehouse Architect for CMA Consulting Services of Latham, NY, spoke about how the influx in troves of data, and the analytics of that data, are allowing organizations to be able to make informed and timely decisions as opposed to the old model that was basically decisions made off the cuff, based on intuition.

CMA Consulting services is responsible not only for providing those key data analytics, but also the development of products specifically tailored to their client’s needs. This means CMA will construct the physical database an organization needs and then put software products on top of it meant to assist the company with full adoption and implementation of their new architecture.

Speaking on the limited history of big data analytics, Dougherty reflected on how much the industry has grown and changed over the last 15 years. “The adaptability, the scale have all changed significantly,” he noted. The world of big data today is far different than the early days because we are ingesting data at the speed of thought.

“We think we’re gonna see a slow morphing of traditional data warehouses,” stated Dougherty. “Hadoop will take on a more traditional ETL platform. Some of the more costly products will be displaced by Hadoop.”

CMA’s business model whole heartedly embraced convergance. They see their model as providing a large scale cluster, or private cloud, out of which they can segregate individual clusters for their clients. This makes their model more flexible, (and more affordable), than others that are still tied to the development and dissemination of traditional warehouse architectures.

Addressing the diminished cost, Dougherty claimed CMA’s model effectively cuts the total cost of implementation by a factor of some 400-500 percent. What used to require in the 10’s of millions of dollars can now be achieved for several hundred thousand dollars. But with diminished cost comes a sacrifice in functionality.

Dougherty acknowledges several components that have had the opportunity to mature over the past decade and a half just cannot be delivered on CMA’s architecture. However, the business value offered by forward-thinking data architecture firms will soon overwhelm traditional architecture companies.

One reason Dougherty seems so sure about this eventuality is because when the older components were first conceived, no one even considered a future that included a dearth of mobile devices and the data they create. “We see device information as a high growth sector going forward,” he said.

Be sure to watch each of the interviews from the HP Vertica Big Data Conference live at siliconangle.tv or visit our YouTube channel to see each archived broadcast.


A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU