Today is Om Malik’s #bigdataconf, a special one-day event he’s holding under the umbrella of his series of cloud-centric Structure conferences. We’ve been following the emergent trend of Big Data here at SiliconANGLE for well over a year now, and a lot of the questions posed as themes for the conference have been addressed by folks we’ve talked to in our research, and many of his speakers are alum from #theCube.

Throughout the day, we’ll be broadcasting live on SiliconANGLE.TV and here on SiliconANGLE.com and engaging conference-goers as well as SiliconANGLE regular readers on the topic via Twitter using the conference hashtag: #bigdataconf. We invite you to join us as we explore with Om’s audience the topic of Big Data.

Hadoop, a MapReduce and Google File System-inspired software framework for data-intensive distributed applications, with thousands of nodes and petabytes of data, is making a lot of buzz by finally launching Hadapt, a company which started out as HadoopDB project, a computer science project at Yale University. With an angel funding and three superstars (namely Yale professor Daniel Abadi, CEO Justin Borgman, Chief Scientist Kamil Bajda-Pawlikowski, and 3 coders), the undertaking is focused on making Hadoop more interoperable with both structured and unstructure analytics with better mySQL functionality for the benefit of enterprises.

The products have a couple of design partners but its official beta launch is not specified. From the word “adaptive”, Abadi claims that Hadapt is more advanced when it comes to query optimization and planning than most DBMS. It will speed up analytics application on virtual environments even though most companies have non-virtual databases. However, it has not clearly defined Hadapt’s advantages over a DBMS-based analytics platform such as MapReduce. The idea though is to get the same SQL/MapReduce intergration than Hive but boasting better performance.

“I think we are witnessing the second industrial revolution,” says Abhishek Mehta, then the managing director for big data an analytics at Bank of America, but now working on his own big data-centric startup. “And it is fueled by data. And it will bigger than the first industrial revolution, because finally technology has democratized not just the access of data to a plethora of new companies but also the ability to store, mine, clean, analyze, and produce data products that can solve problems that you could not have solved before.”

“The playing field is now cleared for companies like ours,” said Justin Borgman, CEO and co-founder of Hadapt, addressing large computer systems spending billions acquiring software to analyze structured data –EMC acquiring Greenplum, Teradata buying out Aster. The endpoint for Hadapt is to take over massive data-warehousing offered by companies such as EMC and Teradata. Hadapt will be closed source even though it will rely on other people’s open source software. It decompresses data prior to its node to node transition.

“Web companies like Google, Amazon and Yahoo have made this model work with innovations like Big Table, MapReduce, S3 and Hadoop, powering Web 2.0 innovations. It’s only a matter of time before this type of simplified technology captures the majority of new data that is exploding in enterprises; and that time is now.” – Dave Vellante

Here is our interview with Cloudera CEO Mike Olson’s take on the origins of Hadoop, the problems it address and its consumer-base. Hadoop’s also been named as one of the top SaaS trends to watch from an IT management standpoint, according to Deloitte.

Watch live video from SiliconANGLE.com on Justin.tv