DeveloperANGLE: AllThingsHadoop Podcast with Cube Alum Arun Murthy on Hadoop
The allthingshadoop blog had a great podcast and blog post with Hortonworks cofounder Arun Murthy, a SiliconANGLE.tv Cube Alum.
Here is the podcast: Episode #8 of the Podcast is a talk with Arun C. Murthy.
Main areas they talked about — Hortonworks HDP1, the first release from Hortonworks, Apache Hadoop 2.0,NextGen MapReduce (YARN) and HDFS Federations.
Hortonworks Data Platform (HDP)
Hortonworks Data Platform (HDP) is a 100% open source data management platform based on Apache Hadoop. It allows you to load, store, process and manage data in virtually any format and at any scale.
Apache Hadoop 2.0
Apache Hadoop 2.x consists of significant improvements over the previous stable release (hadoop-1.x). Two areas include HDFS Federation and MapReduce NextGen aka YARN.
HDFS Federation:
HDFS Federation uses multiple independent Namenodes/Namespaces to scale the name service horizontally. The Namenodes are federated, that is, the Namenodes are independent and don’t require coordination with each other. The datanodes are used as common storage for blocks by all the Namenodes. Each datanode registers with all the Namenodes in the cluster. Datanodes send periodic heartbeats and block reports and handles commands from the Namenodes.
MapReduce NextGen:
The new architecture introduced in hadoop-0.23, divides the two major functions of the JobTracker: resource management and job life-cycle management into separate components. The new ResourceManager manages the global assignment of compute resources to applications and the per-application ApplicationMaster manages the application‚ scheduling and coordination.
For more details check out the full post at AllThingsHadoop.com
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
