UPDATED 16:00 EST / AUGUST 12 2015

NEWS

4 myths surrounding Big Data | #HPBigData2015

Facebook is one of the heaviest users of Big Data analytics. During a keynote address at the HP Big Data Conference 2015, Ken Rudin, head of analytics at Facebook, broke down four common myths surrounding Big Data.

The first is that in order to have a Big Data system, you have to use Hadoop. Rudin asserted companies should focus on Big Data from the perspective of business needs, which will lead to a broader look at technology. Rudin said that Hadoop is not always the answer, and sometimes it is even the “wrong tool.” Facebook uses relational database technologies to extend its results, whereas it uses Hadoop to look though “mountains and mountains of data to find the gems,” including the historical data. Rudin recommended asking, “What technology is the best tool for the job?”

Big Data does not always provide better answers

Another misconception is that “Big Data provides better answers,” but Rudin repudiated this assumption by saying that Big Data leads to “more answers and deeper insight on data.” Rudin said that Big Data often results in “brilliant answers to questions that no one cares about.” He stated the best way to  better answers is not to throw Big Data at a problem, but to formulate better questions. Furthermore, the path to better questions requires the best people asking how to get solutions to business problems.

To that end, Facebook sends its people to a two-week “Data Camp” where they learn a common language on how to use data. This hits on the third myth Rudin covered: “that data science is a science.” Rudin commented that businesses must also look at the art side of data science. He claimed that only 50 percent of data science has to do with “how to use the tool” and the other 50 percent stems from “how to frame questions to answer with data.” Rudin said, “A good idea is like sandpaper; it can’t make a good idea, but it can shape it” through an understanding of the industry.

Lastly, Rudin spoke about the assumption that “actual insight is the goal of analytics.” He countered that results from that insight are the true goal. Rudin advocated that data scientists have to make sure that people act on your insight” by evangelizing your insight.

Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of the HP Big Data Conference 2015.

Photo by SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.