Big Data Analyst -using Sqoop and Advance Hive (CCA159)

You will start by learning what is Hadoop &  Hadoop distributed file system and most common hadoop commands required to work with Hadoop File system

Then you will be introduced to Sqoop Import

• Understand lifecycle of sqoop command.

• Use sqoop import command to migrate data from Mysql to HDFS.

• Use sqoop import command to migrate data from Mysql to Hive.

• Use various file formats, compressions, file delimeter,where clause and queries while importing the data.

• Understand split-by and boundary queries.

• Use incremental mode to migrate the data from Mysql to HDFS.

Further, you will learn Sqoop Export to migrate data.

• What is sqoop export

• Using sqoop export, migrate data from HDFS to Mysql.

• Using sqoop export, migrate data from Hive to Mysql.

Finally, we will start with Apache Hive [Advance]

• Hive Intro

• External & Managed Tables

• Insert & Multi Insert

• Data Types & Complex Data Types

• Collection Function

• Conditional Function

• Hive String Functions

• Hive Date Functions

• Mathematical Function

• Hive Analysis

• Alter Command

• Joins, Multi Joins & Map Joins

• Working with Different Files - Parquet,Avro

• Compressions

• Partitioning

• Bucketing

• Views

• Lateral Views/Explode

• Windowing Functions - Rank/Dense Rank/lead/lag/min/max

• Window Specification