This course will introduce a developer to various components of Hadoop ecosystem (HDFS, MapReduce, Pig, Hive and HBase). At the completion of the course students will be enabled to understand core concepts, hadoop Clusters and tools,learn
best practices for building Hadoop Solutions,write MapReduce program,develop programs using Hive and Pig and design Data Pipelines.
Duration:
4 Days
Audience:
Developers, Solution Architect
Prerequisites:
Comfortable with programming and unix commands
Course outline:
<p><strong>Section 1: Introduction to Hadoop </strong></p>
<p>hadoop history, concepts,eco system, distributions, high level architecture, hadoop myths, hadoop challenges, hardware / software</p>
<p><strong>Section 2: HDFS</strong> </p>
<p>concepts (horizontal scaling, replication, data locality, rack awareness), architecture, Namenode, Secondary namenode, Data node, communications / heart-beats block manager / balancer, health check / safemode, read / write path, file systems abstractions, data integrity, future of HDFS : Namenode HA, Federation, lab exercises</p>
<p><strong>Section 3: Map Reduce </strong></p>
<p>mapreduce concepts, daemons : jobtracker / tasktracker, phases : driver, mapper, shuffle/sort, reducer, counters, distributed cache, combiners, mapreduce configuration, MR types and formats, sorting,Joins (map side & reduce side),job schedulers,unit testing,Thinking in map reduce, Future of mapreduce (yarn), lab exercises </p>
<p><strong>Section 4: Pig</strong> </p>
<p>pig vs java map reduce, pig job flow, pig latin language, lab exercises</p>
<p><strong>Section 5: Hive</strong> </p>
<p>hive concepts, architecture, data types, hive vs sql, lab exercises </p>
<p><strong>Section 6: HBase</strong> </p>
<p>Intro, concepts, architecture, hbase vs RDBMS, read path / write path, schema design, lab exercises</p>
<p class="MsoNormal" style="margin-left: -11.7pt; line-height: 12.5pt; background-position: initial initial; background-repeat: initial initial;" align="left"> </p>
