Hadoop Administration: Online Hadoop Admin Training

Name: Hadoop Administration: Online Hadoop Admin Training
Rating: 3.5 (180 reviews)

Become a Hadoop Administrator from Scratch

Created byInflame Tech

Last updated 2/2019

English

What you'll learn

Setup a machine in VirtualBox
How to add CentOS ISO image
Start machines and make way to communicate
Generating ssh key
Format Namenode
Demerit to store data in tmp
Start Admin commands
Setting the pesudo distributed mode
Commisioning and Decommisioning of Nodes
Working of Secondary NameNode
Shutting down the namenode
Using Namespace
Backing up the data
Restore the data
Distcp Command
Handle Crashing of NameNode
Corrupt and Missing Blocks
Getting metadat from secondary to primary location
How to Manage a Hadoop Cluster
How to Maintain a Hadoop Cluster
How to Monitor a Hadoop Cluster
How to Troubleshoot a Hadoop Cluster

Course content

7 sections • 69 lectures • 5h 12m total length

1.1 Data Processing in Hadoop8:04
Explore data processing in Hadoop by mastering map jobs, their input-output flow through the file system, and how scheduling, monitoring, and resource management drive a Hadoop cluster.
1.2 HDFS in Hadoop11:25

2.1 Download Virtual Box2:33
2.2 Downloading CentOS2:15
Learn how to download CentOS, select the correct 32-bit or 64-bit iso image, and download a dvd iso from centos.org for installation.
2.3 How to setup a machine in VirtualBox3:11
2.4 How to add CentOS ISO image2:42
2.5 Start Your Machine3:46
2.6 Start machines and make way to communicate7:14
2.7 How to install Java in VirtualBox4:13
2.8 Download Hadoop1:28
Download Hadoop 1.6 for your two virtual machines by visiting the recommended download site, selecting the Hadoop 1.6 package, saving the file, and repeating for both machines.
2.9 Add Group and User3:11
Create a group and a user, assign a password, and update the user profile across multiple machines to enable Hadoop administration tasks.
2.10 generating ssh key5:00
2.11 distributing the keys6:56
Distribute ssh keys across local and remote machines to enable passwordless logins. Create rsa public keys, add them to authorized_keys, and verify known_hosts entries for seamless access.
2.12 setting java3:35
2.13 Hadoop path setting4:32

3.1 Starting With hadoop3:14
3.2 Changing Conf files6:20
3.3 Format Namenode4:11
3.4 Starting the daemons2:46
3.5 Checking the file system2:27
3.6 Creating a Directory and putting data2:51
3.7 Demerit to store data in tmp5:41
3.8 Start Admin commands1:31
Learn to start Hadoop admin commands and navigate the file system, then use the admin report to view present capacity, used blocks, and available data.
3.9 Browser Interface3:49

4.1 Setting the pesudo dist mode13:28
4.2 viewing the fully distributed mode3:41
4.3 Using a Script file to monitor the cluster1:42
4.4 Viewing under replicated blocks7:47
Learn to view under replicated blocks in hdfs, identify missing or under replicated blocks, and understand how configured capacity and replication affect block availability when blocks come back online.
4.5 Setting the third machine6:26
Setting the third machine in a fully distributed Hadoop cluster, the session covers provisioning a new host, installing Hadoop, configuring hosts and ports, and ensuring firewall allowances for inter-node communication.
4.6 Bringing up the third machine7:17
4.7 OverReplicated Blocks5:02
4.8 Commisioning and Decommisioning1:57

5.1 Metasave Command2:16
5.2 Dynamically Write Data with different Replication2:17
5.3 Rack Awareness1:44
5.4 Enabling Rack Awareness6:36
5.5 default Rack3:31
When a new machine comes online in a Hadoop cluster, it joins the cluster even without topology information, and topology determines which rack the node belongs to, guiding data placement.
5.6 Working of Secondary Namenode5:33
Learn how the secondary namenode performs checkpointing by merging edits with the fsimage, updating the image, and reducing log growth on a separate machine.
5.7 Secondary namenode working in the cluster setup3:30
5.8 Changes in Cluster viewing the fsimage8:01
5.9 Shutting down the namenode8:30
Shut down the namenode and trace how the image updates reflect changes to blocks, logs, and data state, including reconnection after crashes.
5.10 manually talking to namenode7:56
5.11 Safemode in hadoop3:45
5.12 Using Namespace5:22
5.13 Commissioning and decommissioning Nodes1:46
5.14 setting for commissioning decommissioning6:30
5.15 Decomissioning of Nodes5:10
5.16 Commissioning in Hadoop6:03

6.1 Balancer3:10
This video is about Balancer in Hadoop.
6.2 Backing up the data5:48
This video is about Backing up the data.
6.3 Backing up the data continued5:23
This video is about Backing up the Data.
6.4 Restore the data1:53
This video is about Restore the data.
6.5 Deleted data Permanently3:09
This video is about Deleted data permanently.
6.6 Working with Distcp3:20
This video is about Working with Distcp.
6.7 Distcp across the cluster8:30
This video is about Distcp across the cluster.
6.8 Disctcp log files2:36
This video is about Distcp log files.

7.1 Namenode Crashes8:08
7.2 Corrupt and Missing Blocks2:53
7.3 Starting the second datanode4:03
7.4 Starting Namenode on old machine4:45
Restart the namenode on an old machine by stopping all daemons, validating storage locations, and recovering metadata from the image and checkpoint to restore replication.
7.5 Starting Namenode on old machine II3:52
Learn to start the Namenode on an old machine by leveraging an existing DFS image, transferring the image, and bringing the Namenode up on the target host while preserving data.
7.6 Working with Updated Metadata2:44
7.7 Multiple Paths to run the cluster3:54
Explore multiple paths to run a Hadoop cluster, and learn upgrade and recovery approaches to keep the cluster operating during disk failures and downtime.
7.8 NFS Settings1:31
7.9 Start NFS4:17
7.10 Start the cluster4:12
Start the cluster and verify all services are running to ensure the Hadoop environment is healthy. Practice starting and stopping components, and check that every machine is working as expected.
7.11 Deleting Primary Path of Namenode2:40
7.12 Getting metadat from secondary to primary location3:14
7.13 Starting cluster Normally3:37

Requirements

You will need access to a PC running 64-bit Windows, MacOS, or Linux with an Internet connection.
You must have at least 8GB of free RAM on your system.
If you have not a PC that does not meet these requirements, you can still follow along in the course without doing hands-on activities.
A basic familiarity with the Linux command line will be very helpful.

Description

The course Hadoop Administration from Inflametech provides with all the skills in order to successful work as a Hadoop Administrator and also provides expertise in all the steps necessary to manage a Hadoop cluster. This course on Hadoop Administration will make you expert in working with Hadoop clusters and deploy that knowledge on real world projects. In this course you’ll learn:

How to Plan and Deploy a Hadoop Cluster
How to load Data and Run Applications
Configuration of a Hadoop Cluster
Performance Tuning of Hadoop Cluster
How to Manage Hadoop Cluster
Maintaining a Hadoop Cluster
Monitoring a Hadoop Cluster
Troubleshooting a Hadoop Cluster

Understanding Hadoop Administration is a highly valuable skill for anyone working at companies with Hadoop Clusters to store and process data.

Almost every large company you might want to work at uses Hadoop in some way, including Google, Amazon, Facebook, Ebay, LinkedIn, IBM, Spotify, Twitter, and Yahoo! And it's not just technology companies that need Hadoop; even the New York Times uses Hadoop for processing images. And Now you can understand if the companies are using Hadoop for storing, analyzing and processing data then there will be a requirement for Hadoop Administrator.

Our Course Hadoop Administration: Online Hadoop Admin Training have 5 Hours of VIDEO. It's filled with hands-on activities, so you get some real experience in CREATING AND MANAGING Hadoop CLUSTER- it's not just theory.

You'll walk away from this course with a real, deep understanding of Hadoop Administration, and you can apply this to manage, monitor and troubleshoot Hadoop cluster. Plus a valuable completion certificate is waiting for you at the end!

Please note the focus on this course is on Hadoop administration not on Application development. Although you will pick up some basic hadoop skills along the way.

Knowing how to wrangle with "managing Hadoop Cluster" is an incredibly valuable skill for today's top tech employers. Don't be left behind - enroll now!

Excellent course by Inflame Tech. Really appreciate their work in defining the course content and also knowledgeable session on the course content.

--Surbhi

I am glad to have such a great course on Udemy. Full marks to the instructor!!

--Catherine Marin

Who this course is for:

Software engineers and programmers who want to understand the administration of larger Hadoop ecosystem.
Hadoop Developers and Java Developers who want to be a Hadoop Administrator and have interest in Big Data Field.
Project, program, or product managers who want to understand how to manage, monitor and troubleshoot the Hadoop Cluster
Linux / Unix Administrator, Data analysts and database administrators who are curious about Hadoop Administration part and how it relates to their work.
Database Administrator, System architects who need to understand the components available in the Hadoop ecosystem, and how they manage and monitor them.

Hadoop Administration: Online Hadoop Admin Training

What you'll learn

Explore related topics

Course content

Module 12 lectures • 19min

Module 213 lectures • 51min

Module 39 lectures • 33min

Module 48 lectures • 47min

Module 516 lectures • 1hr 19min

Module 68 lectures • 34min

Module 713 lectures • 50min

Requirements

Description

Who this course is for: