Sqoop and Flume
4.4 (10 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
536 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Sqoop and Flume to your Wishlist.

Add to Wishlist

Sqoop and Flume

Data Ingestion in Hadoop
4.4 (10 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
536 students enrolled
Created by Gaurav Vyas
Last updated 1/2017
English
Current price: $10 Original price: $35 Discount: 71% off
5 hours left at this price!
30-Day Money-Back Guarantee
Includes:
  • 2.5 hours on-demand video
  • 7 Supplemental Resources
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
What Will I Learn?
  • Know about Hadoop and its requirment, Hadoop's ecosystem.
  • know some Unix / linux commands required in day to day life of a Hadoop professional
  • know HDFS file system commands in Detail
  • Learn How to ingest Structured Data in Hadoop using sqoop
  • Learn How to Take Data from Hadoop and export it in to RDBMS
  • Learnt Apache flume, How to configure it, Know about Various sources, sinks and channels
  • How to configure and use Flume to ingest Data into HDFS
View Curriculum
Requirements
  • No previous knowledge of Hadoop is required
  • Introduction to very basic sql commands will be helpful but not a requirement
Description

this is detailed course upon Data Ingestion in Hadoop.  very first Step towards analyzing Big Data. Learn How you can use Hadoop's file system commands to move Data in or out of HDFS. then we will Move ahead and see How can we transfer structured Data in and out of HDFS and RDBMS, we will see Many use cases, and I will be giving you live demo of each and every step. then we will take one more step and see How we can ingest log Datas using apache flume, we will then configure and make a data ingestion pipeline which will fetch data from social network website like twitter and ingest it to HDFS.

during the course I will be doing coding in front of you and will be explaining everything simultaneously so things will become more clear.

you are not required to know about Hadoop for joining the course, as this course is made with the assumption that students doesn't have a prior knowledge of Hadoop.

a very little introduction to sql commands is good, but again its not a requirement, as I will be giving you the commands as and when needed when we will be seeing module dedicated to sqoop. Nothing more than the create table and select * from table is required for this course if sql is your concern.

Java is not required as there will not be any Java or any other programming language's coding in this course

Who is the target audience?
  • software engineers
  • IT Professionals
  • Students
  • anyone who wants to learn Data Ingestion in Hadoop
Students Who Viewed This Course Also Viewed
Curriculum For This Course
16 Lectures
02:36:46
+
Introduction to Hadoop
4 Lectures 23:36


Hadoop-2
07:22

Hadoop-3
05:12
+
Data Ingestion in Hadoop: Hadoop Distributed File System (HDFS Commands)
2 Lectures 22:58
HDFS-1
14:01

HDFS-2
08:57
+
Sqoop: RDBMS to HDFS
6 Lectures 01:12:16

Sqooop-2
16:58

Sqoop-3
12:14

Sqoop-4
13:32

Sqoop-5
12:25

Sqoop-6
08:04
+
Flume: Data Ingestion Pipe line
3 Lectures 34:18
Flume-1
09:05

Flume-2
09:24

Flume-3
15:49
+
Bonus
1 Lecture 03:38
Thank you Very Much
03:38
About the Instructor
Gaurav Vyas
4.5 Average rating
12 Reviews
549 Students
2 Courses
Hadoop Developer

Gaurav Vyas has more than 10 Years of experience.

He is working in technologies like Hadoop and its ecosystem  MapReduce, Apache Pig, Hive, Impala, Zookeeper, Spark with both Scala and python apis. He also has a very good experience working in NoSqls HBASE and MongoDB.

He has also used Functional programming languages like R and Scala for various projects.