Advance Hadoop and Hive for Testers

Name: Advance Hadoop and Hive for Testers
Rating: 3.8 (48 reviews)

Hadoop and Hive for Big Data Testing

Created byLead Big Data Engineer

Last updated 1/2026

English

What you'll learn

At the end of this course, students would understand the Hadoop and Hive with advance queries and commands that are required from testers
At the end of this tutorial, students would be able to start their career in Big Data Testing with this technology at different levels.
This course prepares students to apply these skills in practical testing scenarios and confidently begin a career in testing.
At the end of this course, students will understand Redis, Oozie, and HBase, master advanced queries and commands required for testing, and be ready to work

Course content

5 sections • 57 lectures • 7h 51m total length

Course Introduction5:47
After completing this video, students will get the information about this complete tutorial.
Big Data History3:54
After completing this video, students will get the information about this big data testing background.
5 V's of Big Data9:25
After completing this video, students will get the information about this 5 Vs that makes the complete big data in testing.
Data Support for Big Data - Structured Data3:26
After completing this video, students will get the information about the structured data format in big data testing in this complete tutorial.
Unstructured Data in Big Data2:57
After completing this video, students will get the information about the un-structured data format in big data testing in this complete tutorial.
Semi-Structured Data in Big Data2:19
After completing this video, students will get the information about the semi-structured data format in big data testing in this complete tutorial.
Hadoop Testing4:15
After completing this video, students will get the information about the Hadoop Testing in big data testing.
HDFS Overview in detail with Architecture12:06
Explore hdfs architecture in detail, from the environment and clusters to the resource manager daemons, blocks, and how jobs run across the distributed dfs.

Practical Session - Different HDFS Commands (Ubuntu Enviornment)7:35
Learn practical HDFS commands in Ubuntu to browse the file system, view data on the Hadoop cluster, and explore NameNode information in a Cloudera cloud environment.
Practical Session - Different HDFS Commands (Ubuntu Environment)10:48
Explore practical HDFS commands in an Ubuntu environment to list directories, check file sizes, read data, and manage user directories and files.
Student Practice - HDFS Commands2:14
Practical Session - Different HDFS Commands-3 (File Related i.e.Create/Append)9:06
Explore practical HDFS commands for file management, including creating files, appending data, and navigating directories, with hands-on testing to verify file contents and labels.
Practical Session - Different HDFS Commands-4 (copy from local to hadoop)8:11
Practical Session - Different HDFS Commands-5 (copy from hadoop to local)5:47
Copy data from HDFS to the local filesystem using copy and get commands, and verify files on the desktop. Demonstrate choosing source and destination paths and completing a successful transfer.
Practical Session - Different HDFS Commands-6 (remove file from hadoop cluster)7:15
Learn to remove files from a Hadoop cluster using HDFS commands, including recursive removal with -R, verification with ls, and managing directories.
Practical Session - Different HDFS Commands-7 (file permission on cluster)7:26
Explore HDFS file permissions on a cluster by practicing permission changes, viewing access rights, and using user and group concepts in a Cloudera environment, including 777 permission examples.
Practical Session - Different HDFS Commands-3 (copy and move on hdfs cluster)9:17
Explore practical hdfs commands to copy and move files across a cluster, practicing transfers between locations and validating results within the hdfs filesystem.
Execute Hadoop Jar for Word Count Program from Hadoop Terminal7:31
How to Work with Map-Reduce for Word Count Example in Eclipse?9:53

Hive Background and Overview4:22
Hive Comparison with Traditional Databases with Hive Features6:17
Explore how Hive features compare with traditional databases, highlighting a sql-like interface, batch processing, open-source advantages, and handling of text data for efficient data analysis.
Different Hive Table Types2:41
How to Create Hive Managed Table?13:06
Explore creating Hive managed tables in a running Hive environment, learn to read and view data, insert values, and distinguish default versus external tables for Hadoop and Hive testing.
How to Create Hive External Table?8:03
How to execute Hive Tables using Script File?9:48
Hive - Update and Delete Queries16:01
Hive - Static Partition17:09
Hive - Dynamic Partition22:24
Hive - Bucketing12:07
Explore Hive bucketing concepts, including creating buckets by region, configuring enforced bucketing, and leveraging bucket counts to organize and query dynamic data efficiently.
Hive - Compare Two Hive Tables17:44

Student Practice - Unix Commands3:00
Advance Unix Comamnds - 1 (SED)9:05
Advance Unix Comamnds - 2 (SED)3:56
Learn how to use sed for advanced text substitutions, performing global replacements, addressing specific lines, and applying pattern-based edits in Unix workflows.
Advance Unix Comamnds - 3 (SED)6:11
Advance Unix Comamnds - 4 (SED)5:14
Advance Unix Comamnds - 5 (SED)3:47
Advance Unix Comamnds - 1 (AWK)10:56
Advance Unix Comamnds - 2 (AWK)6:39
Advance Unix Comamnds - 3 (AWK)3:32
Advance Unix Comamnds - 4 (AWK)8:13
Advance Unix Comamnds - 5 (AWK)7:09
Unix Commands - 16:25
Master Unix commands to navigate directories, create and edit files, move between locations, and use editors like vi or nano to manage data in the default location.
Unix Commands - 210:56
Unix Commands -34:58
Unix - Airthemetic Operators19:48
Head and Tail4:27
Explore how to display specific lines with head and tail, specify line ranges and counts, and control output in data workflows for Hadoop and Hive testing.
More and Less3:50
Shell Scripts - Arrays10:36
Shell Scripts - Loops9:31
Student Parctice - HDFS Commands - 1 (Cloudera Enviornment)12:06
Explore HDFS commands in a Cloudera environment, including listing files, navigating directories, and creating directories to manage Hadoop data.
Student Prtactice - HDFS Commands - 2 (Cloudera Enviornment)7:20
Student Practice - HDFS Commands - 3 (Cloudera Enviornment)7:13
Copy files from your local system to the HDFS cluster in a Cloudera environment using HDFS commands. Verify the transfer by listing the destination on the cluster with ls.
Student Practice - HDFS Commands - 4 (Cloudera Enviornment)7:16
Hadoop Questions - Part 17:06
Explore interview questions on big data tools, including accessing Cassandra tables with select, Hive table types, data testing sizes, and partitioning data by date or country.
Hadoop Questions - Part 25:06
Questions - MySQL8:23

Requirements

As such there is no prerequisite required for this course and it is useful for any level of tester. Any Tester profile candidate can start this tutorial.
Any QA can start this course who has basic knowledge of any database and Unix. There is no specific prerequisite other than this.

Description

This course is specially designed for Testing profile students who wanted to build there career into Big Data Testing. So I have designed this course so they can start working with Hadoop and Hive in big data testing. All the users who are working in QA profile and wanted to move into big data testing domain should take this course and go through the complete tutorials which has advance knowledge.

I have included the material which is needed for big data testing profile and it has all the necessary contents which is required for learning Hadoop, Hive and Unix.

It will give the detailed information for different Hadoop and Hive commands which is needed by the tester to move into bigger umbrella i.e. Big Data Testing.

This course is well structured with all elements of different Hadoop, Hive with advance commands in practical manner separated by different topics. Students should take this course who wanted to learn Hadoop, Hive and advance Unix from scratch.

Who this course is for:

Any Level of Testing Profile Candidate is the target audience for this course.
Any big data QA beginner use this technology to enhance their skills.

Advance Hadoop and Hive for Testers

What you'll learn

Explore related topics

Course content

Hadoop Introduction8 lectures • 44min

Cloudera Setup Process1 lecture • 20min

HDFS Practical Sessions11 lectures • 1hr 25min

Hive Practical Sessions11 lectures • 2hr 10min

Unix Practical Sessions26 lectures • 3hr 13min

Requirements

Description

Who this course is for: