Learn Big Data Testing with Hadoop and Hive with Pig Script
3.7 (68 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
679 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Learn Big Data Testing with Hadoop and Hive with Pig Script to your Wishlist.

Add to Wishlist

Learn Big Data Testing with Hadoop and Hive with Pig Script

Big Data Testing - Hadoop & Hive including Unix, Shell and Pig Scripting
3.7 (68 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
679 students enrolled
Last updated 5/2017
English
Current price: $10 Original price: $80 Discount: 88% off
5 hours left at this price!
30-Day Money-Back Guarantee
Includes:
  • 10 hours on-demand video
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
What Will I Learn?
  • At the end of this course, students would be able to get the knowledge about Hadoop Big Data Testing.
  • Also, students would get the knowledge of Hive Query language with Hadoop data integration.
View Curriculum
Requirements
  • Basic understanding on big data and testing profile.
Description

This course is for Big Data testing with Hadoop tool.

The target audience for this tutorial is who all are willing to learn big data testing and wanted to make his/her career into big data testing.

I have included the material that is needed for big data testing profile.

All the users who is working in testing profile and wanted to move into big data testing should take this course and go through the complete tutorials.

Who is the target audience?
  • User those have at least basic knowledge of big data and they are in testing profile.
Students Who Viewed This Course Also Viewed
Curriculum For This Course
71 Lectures
10:02:04
+
Big Data Testing - Hadoop
4 Lectures 21:24

After this session, students would get to know the complete agenda on this tutorial which we are going to cover in this.

Preview 04:08

This video has covered why we need big data and what is in it for Testing.

Why we need Hadoop
07:07


This video covered the introduction part of big data Testing with Hadoop.

Big Data Hadoop Introduction
07:07
+
Different Hadoop Commands
8 Lectures 01:09:21
Hadoop Practice Questions for Students
02:45

In this video tutorial, user would get the information for Hadoop installation. Also, they will get to know how to start and stop hadoop services.

Hadoop Installation process and Service Start Stop
12:50

In this video, user would get the details information for hadoop services when running on Ubuntu Machine. It gives the information how they can execute the command in Terminal.

Hadoop Start and Stop on Ubuntu Machine
05:59

In this session, user would get the details about hadoop services and JPS command in detail.

Hadoop Services and JPS Command
11:08

In this video, user would get to know practical example of how to work on different hadoop command i.e. create file, directories etc.

Preview 06:35

In this video, user would get to know practical example of how to work on different hadoop command i.e. moving file within cluster, head, tail, remove etc.

Different HDFS Command Part -2
12:40

How to Work with Map-Reduce for Word Count Example in Eclipse?
09:53

Execute Hadoop Jar for Word Count Program from Hadoop Terminal
07:31
+
Hadoop Background
10 Lectures 01:05:21
Unix and Shell Scripting Practice Questions for Students
03:00

In this session, user would get to know the Hadoop Architecture in detail with NameNode and  DataNode features.

HDFS Architecture with NameNode and DataNode
10:36

In this session, user would get to know the all three modes in which Hadoop Can be executed.

Different Hadoop Running Modes
04:44

In this session, user would get to know all the main components of Hadoop in details and their functionalities.

Hadoop Main Components
05:16

This video tutorial covered the 3 V's available in Big Data Hadoop with detailed information.

3 Vs in Big Data
08:37

In this video tutorial, user would get the detailed information about the different data supports available in Big Data Hadoop. It covered the information with different testing data. 

Hadoop Different Data Supports
06:09

In this video, user would get to know the major differences between Hadoop 1.x version and Hadoop 2.x Version in detail.

Preview 06:39

In this session, user would get to know the HDFS in detail and Hadoop Daemons in details with their functionalities.

HDFS and Hadoop Daemons
10:03

In this session, user would get to know the hadoop block size and input split in details. Also, they will get the knowledge how they can increase or decrease the block size as per the need of the project.

Hadoop Block Size and Input Split
06:34

Automation Related Practice Questions for Students
03:43
+
Big Data Testing - Hive
28 Lectures 04:45:28

In this session, user would get the details overview for Hive Tool which is used with Hadoop for the data processing.

Hive Overview
04:58

Hive Practice Questions for Students
03:03

In this session, user would get the detail view of Hive installation and how to open the Hive terminal for query/table creation.

Hive Installation
06:29

In this session, students would get the knowledge of how to create queries in Hive and with different tables and how we insert records in tables. 

Preview 10:33

In this session, user would get to know the Hive characteristics and their Features in detail.

Hive Characteristics and Features
06:48

In this session, user would get to know the different types of Hive tables and what all are the major differences for different types of Hive tables available in details.

Different Hive Tables and its Differences
04:14

In this session, user would get to know how Hive is different with our traditional RDBMS in details.  

How Hive different with RDBMS
05:42

In this session, user would get to know the different Hive Components in detail with diagram.

Hive Components
04:36

In this session, students would get the knowledge of Managed Table creation i.e. default table of Hive and how we insert values in managed tables.

Hive Queries (Managed Table) - Part2
13:45

In this session, user would get the detail information about how we can create external table and how we can insert data into external table.

Hive Queries (External Table) - Part3
09:03

In this session, students would get to know the basic queries for Hive i.e. how to see database, how to see the table, how to see the schema of table, table creation, data insertion in table etc.

Few Important Hive Basic Queries
13:56

In this session, students would get the knowledge of different Join available in Hive and how we created our queries using these joins which is Inner Join, Left Outer Join and Right Outer Join etc. to fetch the records from multiple tables.

Preview 18:13

In this session, students would get the detailed knowledge of different Hive Partitions. In this video, I have included how Static Partition is implemented in real time projects.

Hive Partitions - Static Partition Implementation
17:09

In this session, students would get the detailed knowledge of dynamic Hive Partitions and its implementation in real time projects.

Hive Partitions - Dynamic Partition Implementation
22:24

In this session, students would get the detailed knowledge on how they can implement the Indexes in Hive and how to query with Indexes and verify the different Indexes created on Hive table in real projects.

Hive - Indexes Implementation
16:46

In this session, students would get the detailed knowledge on how they can implement the View in Hive and how to query the view and verify the different view created on Hive table in real projects.

Hive - Views Implementation
11:05

In this session, students would get the detailed knowledge on how they can implement the Bucketing in Hive and how to query the using this and verify the different buckets created on Hive table in real projects.

Hive - Bucketing
12:07

In this session, students would be able to learn about how to implement the UDFs and how we can use these implemented UDFs through Hive CLI in detailed step by step information.

Preview 15:34

In this session, students would get the knowledge for the insert into and insert overwrite query implementation.

Insert INTO and Insert Overwrite
08:06

In this session, students get the practical implementation of the movielens use case implementation.

Use Case (MovieLens) implementation Part-1
16:22

In this session, students get the practical implementation of the movielens use case implementation.

Use Case implementation Part-2
07:49

In this session, students get the detailed information how they can update or delete the records in Hive table that is by default not available in Hive's lower version.

How to Update and Delete Table Records in Hive
16:01

In this session, students get the detailed information how they can can add columns in existing Hive table.

Preview 03:32

In this session, students get the detailed information how they can can get the Min, Max, Avg and Count value of Hive table using the inbuilt Hive functions.

Min Max Avg and Count Functions Implementation
06:47

In this session, students would get the information about the adding new tables from existing tables available in database in Hive terminal.

Add Table Using Existing Table
09:58

In this session, students get the knowledge how they can rename the table if they wanted using the inbuilt function provided by Hive.

How to Rename Table
05:31

In this session, students get the knowledge how they can replace columns with new schema from existing table schema using the inbuilt function provided by Hive.

Replace Columns Schema
04:00

In this session, students would get the knowledge of different types of Collections available in Hive and how it is implemented.

Collections
10:57
+
Unix/Linux and Shell Scripting
11 Lectures 01:40:02

How to Open file in Editor and Save the file?
10:50

Copy and Move commands
10:56


Head and Tail Commands
04:27

More and Less Commands
03:50

How to Find 'String/Word" from File with word count condition.
08:27

How to Work with SED commands in Unix
09:19

How to Work with AWK command in Unix
12:49

Redirect Output to Other File which is generated from Conditition
06:44

How to Compare Two HIVE Tables to Get the Distinct Records?
17:44
+
Pig Concepts
10 Lectures 01:00:28
Pig Scripting Practice Questions for Students
03:05

Pig Installation
07:36


How to Load Data in Pig from Local Enviornment and Query the Data
09:36

How to test Schema and Metadata?
02:55

Grouping in Pig Script
04:44

How to Filter Data in Pig Scripting (Local Mode)
08:11

How to Limit Pig Script Output?
03:00

How to Load Data in Pig from HDFS Environment and Query?
11:43

How to Filter Data Based on String (HDFS Mode)
05:05
About the Instructor
Big Data Module Lead QA Engineer Big Data QA
3.8 Average rating
216 Reviews
5,006 Students
12 Courses
Big Data QA Module Lead

Having more than 9 yrs industry experience.

Worked on different big data tools like Hadoop, Cassandra, HBase, Hive, Pig, Sqoop, Flume etc. 

ISTQB Certified professional. I have worked with CMMi level 5 companies and provided services to clients in fortune 15 companies like AT&T.

Trained more than 100 professionals in classroom training and more than 50 professionals online.

Training has been my passion and I am on my way to create courses which should help any beginner to step by step learn and be able to become a Big data QA expert.