

During conferences such as Strata+Hadoop World, which takes place in conjunction with BigDataNYC 2015, attendees often want to know what makes a product special. Now that Databricks, Inc., the company founded by the creators of Apache Spark, has a few years under its belt, prospective customers want to know how its colleagues deploy Databricks and the value they receive.
“One of the most interesting things for us is to look at the different types of use cases,” Arsalan Tavakoli, Databricks’s VP of customer engagement, told Dave Vellante and George Gilbert, cohosts of theCUBE, from the SiliconANGLE Media team, during BigDataNYC 2015. “We’ve seen more than 1,000 production deployments so far. “
Databricks recently surveyed more than 1,400 respondents to discover that the number of standalone deployments of Spark eclipses those on YARN as more users run Spark independent of Hadoop. Of Spark customers, 48 percent run Spark in standalone, 40 percent used YARN within Hadoop, and 11 percent used Apache Mesos.
“Fifty percent of our customers have never used Hadoop,” saidTavakoli. “Also, customers that have invested in Hadoop are now looking at Spark to supplement what they have.”
As Spark continues to grow, Tavakoli said customers should watch for new security features that Databricks plans to roll out. The company also plans to keep developing use cases. “Companies always want to know what their peers are doing,” he said
Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of BigDataNYC 2015.
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.