UPDATED 14:00 EDT / OCTOBER 24 2012

How to Make Your Data Scientist More Productive: EMC + Kaggle

EMC is one of the big vendors showcasing at Strata Conference + Hadoop World this week, and its latest update is a huge gesture towards the data hungry crowd that’s attending the event.

The company announced that Greenplum Chorus, an open-source productivity platform for data scientists, will be integrated into Kaggle. The crowdsourcing site’s community of over 55,000 mathematicians and database gurus can now use Chorus to complete contract work.

“The OpenChorus Project is part of a wave of Big Data technologies, strategies, and tools announced by EMC Greenplum all with one unified mission—to expand Big Data opportunities that help customers drive greater business insight and economic value from their data than ever before,” said Scott Yara, Greenplum’s vice president of products. “Success depends on having a collaboration platform and solving the number one problem of the big data era: the supply and demand for data scientists.”

This announcement brings two bleeding-edge technologies together. Chorus is a first of its kind “Office for data scientists”  that delivers advanced search, visualization and indexing capabilities, while Kaggle was the first company to connect the dots between crowdsourcing and data science. Organizations including NASA are choosing to launch algorithm contests instead of relying exclusively on their own talent.

EMC is investing a lot in its relations with the data science community. A few months ago it helped sponsor a competition that challenged teams from around the world to develop a means of gauging “listener’s appreciation of songs and artists” based on metrics as age, gender and browsing history.

A Chinese startup named Shanda Innovations got the big prize at the end, a small team with a lot of VC backing. The whole initiative was powered by Kaggle’s platform. Then there’s EMC’s Global Services division, which packs a powerful punch with its own internal team of data scientists like Frank Coleman. Coleman visited theCUBE at Wikibon HQ earlier this year.


A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.