Real World Hadoop - Upgrade Cloudera and Hadoop hands on
3.5 (2 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
126 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Real World Hadoop - Upgrade Cloudera and Hadoop hands on to your Wishlist.

Add to Wishlist

Real World Hadoop - Upgrade Cloudera and Hadoop hands on

New version of Hadoop? Need to upgrade a running PROD Hadoop Environment without losing data? We show you hands on ...
3.5 (2 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
126 students enrolled
Created by Toyin Akin
Last updated 12/2016
English
Curiosity Sale
Current price: $10 Original price: $90 Discount: 89% off
30-Day Money-Back Guarantee
Includes:
  • 3 hours on-demand video
  • 2 Articles
  • 1 Supplemental Resource
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
What Will I Learn?
  • Simply run a single command on your desktop, go for a coffee, and come back with a running distributed environment for cluster deployment
  • Quickly build an environment where Cloudera and Hadoop software can be installed.
  • Ability to automate the installation of software across multiple Virtual Machines
  • Upgrade the Cloudera and Hadoop Version to the next version of Hadoop
View Curriculum
Requirements
  • Basic programming or scripting experience is required.
  • You will need a desktop PC and an Internet connection. The course is created with Windows in mind.
  • The software needed for this course is freely available
  • You will require a computer with a Virtualization chipset support - VT-x. Most computers purchased over the last five years should be good enough
  • Optional : Some exposure to Linux and/or Bash shell environment
  • 64-bit Windows operating system required (Would recommend Windows 7 or above)
  • This course is not recommened if you have no desire to work with/in distributed computing
  • This course is built on top of - "Real World Vagrant - Automate a Cloudera Manager Build"
Description

Note : This course is built on top of the "Real World Vagrant - Automate a Cloudera Manager Build - Toyin Akin" course

.

Upgrading Cloudera Manager enables new features of the latest product versions while preserving existing data and settings. Some new settings are added, and some additional steps may be required, but no existing configuration is removed.

Upgrading Cloudera Manager
The process for upgrading Cloudera Manager varies depending on the starting point. Categories of tasks to be completed include the following:

Install databases required for the release. In Cloudera Manager 5, the Host Monitor and Service Monitor roles use an internal database that provides greater capacity and flexibility. You do not need to configure an external database for these roles.
    Upgrade the Cloudera Manager Server.
    Upgrade the Cloudera Manager Agent. You can use an upgrade wizard that is invoked when you connect to the Admin Console or manually install the Cloudera Manager Agent packages.

Upgrading CDH
Cloudera Manager 5 can manage both CDH 4 and CDH 5. To benefit from the most current CDH features, you must upgrade CDH.

.

Here I present a curriculum as to the current state of my Cloudera courses.

My Hadoop courses are based on Vagrant so that you can practice and destroy your virtual environment before applying the installation onto real servers/VMs.

.

For those with little or no knowledge of the Hadoop eco system Udemy course : Big Data Intro for IT Administrators, Devs and Consultants

.

I would first practice with Vagrant so that you can carve out a virtual environment on your local desktop. You don't want to corrupt your physical servers if you do not understand the steps or make a mistake. Udemy course : Real World Vagrant For Distributed Computing

.

I would then, on the virtual servers, deploy Cloudera Manager plus agents. Agents are the guys that will sit on all the slave nodes ready to deploy your Hadoop services Udemy course : Real World Vagrant - Automate a Cloudera Manager Build

.

Then deploy the Hadoop services across your cluster (via the installed Cloudera Manager in the previous step). We look at the logic regarding the placement of master and slave services. Udemy course : Real World Hadoop - Deploying Hadoop with Cloudera Manager

.

If you want to play around with HDFS commands (Hands on distributed file manipulation). Udemy course : Real World Hadoop - Hands on Enterprise Distributed Storage.

.

You can also automate the deployment of the Hadoop services via Python (using the Cloudera Manager Python API). But this is an advanced step and thus I would make sure that you understand how to manually deploy the Hadoop services first. Udemy course : Real World Hadoop - Automating Hadoop install with Python!

.

There is also the upgrade step. Once you have a running cluster, how do you upgrade to a newer hadoop cluster (Both for Cloudera Manager and the Hadoop Services). Udemy course : Real World Hadoop - Upgrade Cloudera and Hadoop hands on

Who is the target audience?
  • Software engineers who want to expand their skills into the world of distributed computing
  • System Engineers that want to expand their skillsets beyond the single server
  • Developers who want to write/test their code against a valid distributed enviroment
Students Who Viewed This Course Also Viewed
Curriculum For This Course
16 Lectures
03:08:08
+
Introduction
2 Lectures 12:53

It's quite tricky upgrading your Hadoop Cluster in PRODUCTION. We show you one way you can do this using Cloudera Manager

Preview 12:53

Suggested course curriculum to follow ...
Preview 00:00
+
First Steps. Bring up the Environment
3 Lectures 14:11
Course Notes and Resources
00:31

Here we look at the Vagrant Script that will be used to boot up a Cloudera Manager/Agent and Hadoop environment. We then boot up the Environment with a single command! Vagrant up!

Stepping through the MultiNode Virtual Machine topology we are going to build.
11:23

Short background on the Cluster that it about to be built
Short background on the Cluster that it about to be built
02:17
+
Install Hadoop with CDH 5.7.2
3 Lectures 46:24

Install Hadoop with CDH 5.7.2 - Part I

Preview 16:10

Install Hadoop with CDH 5.7.2 - Part II

Install Hadoop with CDH 5.7.2 - Part II
14:50

Install Hadoop with CDH 5.7.2 - Part III

Install Hadoop with CDH 5.7.2 - Part III
15:24
+
Upgrading Cloudera Manager
5 Lectures 01:05:35

Here we walk through the first steps in prepping for a Cloudera CDH 5.8.2 upgrade. The same steps can be used for any upgrade greater than CDH 5.7.2

Prep for Hadoop CDH 5.8.2 Upgrade
14:36

Before we can upgrade the Hadoop Cluster to CDH 5.8.2, we first have to upgrade Cloudera Manager and Agents to at least 5.8.0. Something to consider if you want to upgrade your Hadoop cluster.

First steps - Upgrade Cloudera Manager to 5.8.2
19:54

We now Upgrade Cloudera Agents to 5.8.2. Puppet, Ansible, Chef or Salt would come in handy here!!

Part I - Upgrade Cloudera Agents to 5.8.2
07:26

We now Upgrade Cloudera Agents to 5.8.2. Puppet, Ansible, Chef or Salt would come in handy here!! Also, spot the mistake in Cloudera's docdocumentation!

Part II - Upgrade Cloudera Agents to 5.8.2
10:39

We now Upgrade Cloudera Agents to 5.8.2. Puppet, Ansible, Chef or Salt would come in handy here!!

Part III - Upgrade Cloudera Agents to 5.8.2
13:00
+
Upgrading Hadoop
2 Lectures 37:54

Part I - Upgrade Hadoop Cluster to CDH 5.8.2. Here we describe the process of how parcels are deployed to slave nodes

Part I - Upgrade Hadoop Cluster to CDH 5.8.2
18:37

Part II - Upgrade Hadoop Cluster to CDH 5.8.2

Part II - Upgrade Hadoop Cluster to CDH 5.8.2
19:17
+
Conclusion
1 Lecture 11:12
Conclusion
Conclusion
11:12
About the Instructor
Toyin Akin
3.8 Average rating
135 Reviews
1,374 Students
15 Courses
Big Data Engineer, Capital Markets FinTech Developer

I spent 6 years at "Royal Bank of Scotland" and 5 years at the investment bank "BNP Paribas"  developing and managing Interest Rate Derivatives services as well as engineering and deploying In Memory DataBases (Oracle Coherence), NoSQL and Hadoop clusters (Cloudera) into production.

In 2016, I left to start my own training, POC-D. "Proof Of Concept - Delivered", which focuses on delivering training on IMDB (In Memory Database), NoSQL, BigData and DevOps technology. 

From Q3 2017, this will also include FinTech Training in Capital Markets using Microsoft Excel (Windows), JVM languages (Java/Scala) as well as .NET (C#, VB.NET, C++/CLI, F# and IronPythyon)

I have a YouTube Channel, publishing snippets of my videos. These are not courses. Simply ad-hoc videos discussing various distributed computing ideas.

Check out my website and/or YouTube for more info

See you inside ...