

During conferences such as Strata+Hadoop World, which takes place in conjunction with BigDataNYC 2015, attendees often want to know what makes a product special. Now that Databricks, Inc., the company founded by the creators of Apache Spark, has a few years under its belt, prospective customers want to know how its colleagues deploy Databricks and the value they receive.
“One of the most interesting things for us is to look at the different types of use cases,” Arsalan Tavakoli, Databricks’s VP of customer engagement, told Dave Vellante and George Gilbert, cohosts of theCUBE, from the SiliconANGLE Media team, during BigDataNYC 2015. “We’ve seen more than 1,000 production deployments so far. “
Databricks recently surveyed more than 1,400 respondents to discover that the number of standalone deployments of Spark eclipses those on YARN as more users run Spark independent of Hadoop. Of Spark customers, 48 percent run Spark in standalone, 40 percent used YARN within Hadoop, and 11 percent used Apache Mesos.
“Fifty percent of our customers have never used Hadoop,” saidTavakoli. “Also, customers that have invested in Hadoop are now looking at Spark to supplement what they have.”
As Spark continues to grow, Tavakoli said customers should watch for new security features that Databricks plans to roll out. The company also plans to keep developing use cases. “Companies always want to know what their peers are doing,” he said
Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of BigDataNYC 2015.
THANK YOU