In a discussion yesterday with EMC Data Scientsit Dr. Pedro DeSouza, the conversation turned to the immaturity of the Hadoop ecosystem

Today, the ecosystem grew a bit more as VMware announced Spring Hadoop here at the Strata Conference in Santa Clara.

VMware will make the Spring framework comptable with Apache Hadoop.Costin Leau wrote on the Spring blog. It will become part of the Spring Data umbrella. It fits with stand-alone vanilla MapReduce applications. It can interact with data from multiple data stores across the enterprise. It can coordinate HDFS, Pig or Hive jobs. This does a lot for the ecosystem. Using Hadoop in itself is a bear for most people. It requires intensive development. VMware’s Hadoop adoption signals a move up the stack and the broadening of the ecosystem.

Services Angle

The only way Hadoop will grow is if the ecosystem scales. There’s no question that is happening. The trend is to push Hadoop deeper and deeper as the foundation for higher-level languages. Until this ecosystem matures, the market for Hadoop is in services. I think Dr. DeSouza would certainly agree.