Big Data Analytics Using Sqoop and Hive
4.3 (35 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
864 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Big Data Analytics Using Sqoop and Hive to your Wishlist.

Add to Wishlist

Big Data Analytics Using Sqoop and Hive

Access, Manipulate, Transform, and Analyze Massive data sets with Hands-on
4.3 (35 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
864 students enrolled
Created by Big Data Trunk
Last updated 7/2017
English
Curiosity Sale
Current price: $10 Original price: $195 Discount: 95% off
30-Day Money-Back Guarantee
Includes:
  • 3 hours on-demand video
  • 12 Articles
  • 27 Supplemental Resources
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
What Will I Learn?
  • After this course, students will have all the necessary foundational knowledge which is vital to be a successful big data analytics professional.
View Curriculum
Requirements
  • Basic linux/Unix commands
  • Having knowledge of any one programming language.
Description

Data is the new oil of this Digital Age. 

Are you thinking to start your career in Big Data Analytics ? Then you have landed in the right place.

In this course, you will learn how to organize, analyze and interpret vast sources of information. 

We cover all essential fundamental understanding of Big Data Analytics and provide end-to-end real life project practice.

Course contains 

  1. Understanding of Big Data and MapReduce 
  2. How to transfer Data from different sources using Sqoop
  3. Manipulate Data in HDFS using HIVE
  4. Real Hands experience project 

You will get only in this course :

1) 24*7 support for any issue or doubt raised by student.

2) Exercises in well written document with screenshot.

Who is the target audience?
  • Any one who wants to start his career in big data analytics with internship program.
Students Who Viewed This Course Also Viewed
Curriculum For This Course
46 Lectures
03:18:49
+
Introduction
3 Lectures 10:38

In this video we are providing all features of the course 

Preview 02:17

Big Data Trunk is the leading Big Data focus consulting and training firm founded by industry veterans in data domain. It helps is customer gain competitive advantage from open source, big data, cloud and advanced analytics. It provides services like Strategy Consulting, Advisory Consulting and high quality classroom individual and corporate training. 

Preview 01:47

In this video, we have explained the what is big data analytic, why it is important for companies and business analyst. what is difference between traditional analytic and big data analytic, Application area of big data analytic?
Data analytics Introduction
06:34
+
Newly added section- Installation and Configuration of Cloudera
3 Lectures 14:53

How to install cloudera in 64 bit Window Machine.

Steps of Cloudera Installation
06:17

Step 1: Download the virtual box- executable file from https://www.virtualbox.org/wiki/Downloads

Download Virtual Box 5.0 for Windows hosts The page look like:

Step2: Click on x86/amd64  link, then it starts downloading virtualBox-5.0.0-101573-Win.exe

Step 3:  Click on arrow to open folder contains the file

Step4: Then folder gets open, then double click on that folder to run

Step5 : Installation process starts. Click on Next button.

Step 6: It show default location ; if you want to change location, click on Browse button. Otherwise click on Next button

Step 7: It shows list of options, click on Next button.

Step8 : Then it asks for installation, Click on Next button.

Step9: It asks for review or change in Installation setting If you want any changes in previous process, click on Back button or else, click on Install button

Step10: It starts processing.

Step11: Click on Finish button

Step12: Virtual Box Manager Window appear.

Step13: Click on below link to download Cloudera Quick Start VM

              http://www.cloudera.com/downloads/quickstart_vms/5-7.html

The page look like:

Step14: Fill below screenshot page and Download the required version from menu (Virtual Box in this case)

Step15: Extract files from cloudera-quickstart-vm-5.7.0-virtualbox.

Step16: Double click on cloudera-quickstart-vm-5.7.0-virtualbox.

Step17: Double Click on setup as shown on below

Step18: Click on Import button

                                            Step19: Shows Progress of importing.

Step20: After completion of process of importing, the following window opens; then click on highlighted area to start cloudera on Oracle Virtualbox.

Step21: Running Cloudera on Virtualbox.

Step 22: Finally completed installation.

Hands on Lab: Cloudera Installation
01:18

Know more about Cloudera VM tools
07:18
+
Understand Big Data
4 Lectures 37:33
In this video we have explained, what is big data, Vs of Big data, Importance of Big Data.
Introduction to Big Data
12:24

Introduction to Big Data
2 questions

In this video, we have explained what is Hadoop, how we can use MapReduce in our day-to-day life.

Big Data Concepts
08:13

In this video, we have explained Big data ecosystem, and Big data terms, what are different tools of Hadoop Eco-system.

Big Data Ecosystem
10:32

In this video, we have explained what are the big Data Distribution available in the market, what are the common services available from different Distributions
Big Data Distributions
06:24
+
Understating of MapReduce
3 Lectures 11:53

In this video we have explained, what is mapreduce, what is use of mapreduce, how mapreduce is executed.

Learn MapReduce
02:48

Learn MapReduce
4 questions

In this video, we have explained How map reduces can be applied in solving real life problem.
Map Reduce Core Concept
05:55

Map Reduce Core Concept
4 questions

In this video, we have explained what are the daemons run while executing map reduce job, how daemons communicate with each other to do the job of map reduce.

Map Reduce Concept with Simple Example
03:10
+
Ingestion
11 Lectures 43:00

In this video, we have explained to you what is sqoop, what is flume,  sqoop work flow, sqoop architecture

Introduction of Sqoop
05:53

In this video, we have explained what is import command, how sqoop import command is executed.

Sqoop Import
04:24

Sqoop Import
5 questions

In this video we have explained how to execute commands in terminal,how
to get table list, how to get list of data bases, how to import data in
hdfs.

Import From RDBMS To HDFS
06:38

Hands Lab on Sqoop Import
00:58

Import From RDBMS To HDFS
4 questions

In this video we have explained what is sqoop export, and how it is used.

Sqoop Export
05:50

Hands on Lab Sqoop export
00:50

Sqoop Export
3 questions

In this video we have explained what is incremental sqoop, and how it works.what are the incremental import parameters etc.

Sqoop Incremental Import
05:46

In this video, we have explained what is sqoop jobs how it used and when
it is used. how to create jobs, how to list sqoop jobs available.

Sqoop Jobs
05:41

Hands on Lab Sqoop Job
00:31

Sqoop Jobs
4 questions

In this video,  we have shown you, what is an incremental import, how it is executed, what is a benefit of incremental import.

Hands on Lab: Sqoop Incremental Import
05:30

Hands on Lab Sqoop incremental
00:57

Sqoop incremental import
3 questions
+
Hive
11 Lectures 39:07
In this video, we have explained how Hadoop is applicable in the retail market, how hadoop can play important role in customer analysis
Hadoop in Retail Industry
02:58

In this video, we have given a small introduction of the hive, why Facebook uses hive, where the hive was developed, what are hive features.

Preview 03:24

Hive Introduction
4 questions

In this video, we have explained what is hive Architecture, how the hive is integrated with other hive components, how hive executes hive query.

Hive Architecture
04:26

Hive Architecture
4 questions

In this video we have explained, what are the data type available in HiveQL, what are primitive data type available, Collection data types etc
DataTypes in Hive
03:06

In this video, we have explained what is an internal table, what is an external table, How they are used, what is the feature of hive internal table and external table.

Managed table and External table in Hive
01:51

Managed table and External table in Hive
2 questions

In this video, we have explained what is an external table and internal table, what is the benefit of an external table over an internal table.

Demonstrating difference between Internal and external table
08:00

Hands on Lab Hive ExternalVsInternalTable
01:25

Demonstrating difference between Internal and external table
3 questions

In this video we have explained partitioning in the hive, what is the meaning of partitioning table.
Partitions in Hive with demo
08:25

Hands on Lab Hive Partition
00:47

Partitions in hive
5 questions

In this video we have explained Dynamic partition in hive, what is the usage of hive dynamic table, how to create dynamic table etc.

HIve Dynamic Partitioning
03:42

Hands on Lab HIve Dynamic Partitioning
01:02

HIve Dynamic Partitioning
2 questions
+
Project
11 Lectures 46:05

In this video, we have explained the data masking project, which components we are going to use, what is the use of data masking etc, what are project requirement, what is a flow of the project.

Preview 03:42

In this video, we have explained data masking solution, how this project is executed, what is the goal of the project, what Softwares/tools we are going to use in execution.
Data Masking Project Solution Design
03:19

In this video we have explain the step-by-stpe flow of Data Masking project, and different stages of project.

Data Masking Project Solution Walkthrough
09:05

In this video we have explained how to create table in mysql, how to load data in mysql from file.

DataMaskingProject-step1(Create tables inMySql)
05:40

Hands on Lab DataMaskingProject-step1-Document
02:14

In this video, we have explained how to create an external table, and how to load data in the external table, how to import data from external table to hive table.

Step2:Creating and importing data in hive external tables
03:40

Hands on Lab DataMaskingProject-step2- Document
01:20

In this video we have explained, how to crreate UDFs, and how to jar for Data Masking Project.

Step3:Creating UDFs in Java
06:35

Hands on Lab DataMaskingProject-step3(udf)- Document
03:19

In this video, we have shown you actual execution of data masking, by using MySQL, sqoop.

Step4:Exporting data to MySql in masked database
05:33

Hands on Lab DataMaskingProjectStep4 - Document
01:37
About the Instructor
Big Data Trunk
4.1 Average rating
711 Reviews
12,343 Students
4 Courses
All about Big Data and Hadoop

Big Data Trunk is the leading Big Data focus consulting and training firm founded by industry veterans in data domain. It helps is customer gain competitive advantage from open source, big data, cloud and advanced analytics. It provides services like Strategy Consulting, Advisory Consulting and high quality classroom individual and corporate training.