Learn Ingestion in Hadoop Using Sqoop and Flume Tool

Complete Reference for Apache Sqoop and Flume Tool
3.8 (10 ratings) Instead of using a simple lifetime average, Udemy calculates a
course's star rating by considering a number of different factors
such as the number of ratings, the age of ratings, and the
likelihood of fraudulent ratings.
38 students enrolled
$19
$100
81% off
Take This Course
  • Lectures 26
  • Length 1.5 hours
  • Skill Level All Levels
  • Languages English
  • Includes Lifetime access
    30 day money back guarantee!
    Available on iOS and Android
    Certificate of Completion
Wishlisted Wishlist

How taking a course works

Discover

Find online courses made by experts from around the world.

Learn

Take your courses with you and learn anywhere, anytime.

Master

Learn and practice real-world skills and achieve your goals.

About This Course

Published 5/2016 English

Course Description

Apache Sqoop is a tool designed to transfer data between Apache Hadoop and RDBMS. Apache Sqoop tool is used to import data from traditional databases such as MySQL, Oracle to Hadoop Distributed File System, and export from Hadoop Distributed file system to RDBMS. This course covers these topics of Apache Sqoop and Flume tool:

Overview of Apache Hadoop

Sqoop Import Process

Basic Sqoop Commands

Using Different File formats in Import and Export Process

Compressing Imported Data

Concept of Staging Table

Architecture and Features of Sqoop2 Tool

Flume Architecture

Flume Events

Interceptors and Channel Selectors

Sink Processors


What are the requirements?

  • Basic Knowledge of Apache Hadoop is required but not mandatory.
  • Basic Programming Knowledge in the field of java
  • Basics of Linux Operating System
  • Basics of SQL

What am I going to get from this course?

  • Understand Sqoop Tool Overview
  • How to Import Data
  • How to make use of Sqoop in Hadoop ecosystem
  • Understanding Components of Apache Flume
  • Understand Flume Events
  • Sqoop2 Architecture and Features
  • Sqoop Export Process
  • Staging Table in Sqoop

What is the target audience?

  • Professionals aspiring to make a career in Big Data Analytics using Hadoop Framework with Sqoop
  • Students willing to learn Sqoop tool
  • ETL developers
  • Analytics Professional

What you get with this course?

Not for you? No problem.
30 day money back guarantee.

Forever yours.
Lifetime access.

Learn on the go.
Desktop, iOS and Android.

Get rewarded.
Certificate of completion.

Curriculum

Section 1: Module-1 Introduction to Sqoop and Flume
1.1 Data Integration and It's Tools
Preview
02:17
1.2 Introduction to Apache Sqoop
Preview
03:12
1.3 Introduction to Apache Flume
Preview
02:18
1.4 What You will learn
Preview
01:47
1.5 Prerequisite
Preview
00:37
Section 2: Module-2 Getting Started with Sqoop
2.1 Apache Hadoop
02:03
2.2 Traditional Database Applications
05:10
2.3 Sqoop as an ImportExport Tool
02:06
2.4 Sqoop Import Process
02:00
2.5 Basic Sqoop Commands
03:09
Section 3: Module-3 Importing Data in HDFS using Sqoop
3.1 Transferring an Entire Table
14:14
3.2 Import MySQL Data with Different Options
04:55
3.3 Importing a subset of data and Join Operation
06:14
3.4 Using a file format other than csv
03:50
3.5 Compressing Imported data
03:08
3.6 Speeding Up Transfers
01:51
3.7 Sqoop Codegen
06:33
Section 4: Module-4 Exporting Data from HDFS
4.1 Sqoop Export Process
08:00
4.2 Inserting data into batches
02:04
4.3 Staging Table
01:21
Section 5: Module-5 Sqoop2
5.1 Sqoop1's Challenges
00:51
5.2 Sqoop2 Architecture
01:31
5.3 Sqoop2 Features
00:37
Section 6: Module-6 Apache Flume
6.1 Components of Apache Flume
01:40
6.2 Flume Events
00:49
6.3 Interceptors, Channels,Sink processor
01:45

Students Who Viewed This Course Also Viewed

  • Loading
  • Loading
  • Loading

Instructor Biography

Digitorious Technologies, Make Learning Smarter

Digitorious technologies is a leading publisher of development courses which provide in-depth knowledge and high quality training. Digitorious technologies is serving with a mission of providing right direction to people who are looking for a career in IT/software industry. Digitorious is the best place for learning new technologies and making things easy to understand virtually.

Ready to start learning?
Take This Course