Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Introduction to Hadoop basics in 30 mins
Rating: 4.6 out of 5(303 ratings)
7,179 students

Introduction to Hadoop basics in 30 mins

Basic Hadoop concepts before you start learning Azure HDInsight
Last updated 7/2021
English
English [Auto],

What you'll learn

  • Hadoop - Basic concepts and understanding
  • HDFS, Map Reduce and YARN concepts

Course content

2 sections11 lectures31m total length
  • Is this course good for me? Set expectation0:27
  • Hadoop Overview1:02

    See why traditional systems can't meet today’s data needs and how Hadoop differs from relational databases. Learn Hadoop’s components—SBF or Hadoop distributed file system, Map Reduce, and Yarn—for cluster management.

  • Why we need distribute computing?4:35

    Explore why big data demands distributed computing, how Hadoop enables scalable storage and processing, and the key role of associated technologies in handling Facebook, Google, and similar data volumes.

  • Two ways to build system6:08

    Compare monolithic and distributed systems, showing how a cluster of commodity hardware enables linear scaling by adding nodes, with coordination software managing partitioning, fault tolerance, and parallel tasks.

  • Introducing Hadoop6:25

    Explore the fundamentals of Hadoop, including the Hadoop distributed file system and MapReduce, and see how jobs run across a cluster with Yarn.

  • Hadoop vs RDBMS4:20

    Compare Hadoop and RDBMS, highlighting unstructured data, schema development during processing, and absence of ACID transactions. Explain cap theorem and Hadoop's horizontal scaling, highlighting higher throughput yet slower granular queries.

  • Hadoop Summary0:37

    Explore why distributed computing surpasses a single computer setup and identify the roles of players in a Hadoop ecosystem, with a big-picture view of related technologies.

Requirements

  • Database basic concepts

Description

Important Note:

Please note that this is NOT a full course but a single module of the full-length course, and intended to cover very basic fundamental concepts for absolute beginners so that they can speed up with Azure Synapse SQL Data Warehouse course.

This module is NOT GOOD for you if:

  • You are already experienced in this technology

  • You are looking for an intermediate or advance concepts

  • You are looking for practical examples or demo

This module is GOOD for you if:

  • You want to understand the basic fundamental concepts of this technology.

This is a free module to help others. If you are not in the intended audience, I request you to please feel free to unenroll.

Where I can find a full-length course?

Please look at the bonus lecture in the end.


What will students learn in this course?

  • Hadoop basic concepts (Crash course to speed up with Azure HDInsight)

Level

  • Beginners

Language

  • English

  • If you are not comfortable in English, please do not take course, captions are not good enough to understand course.

Target Students

  • Database and BI developers

  • College students

  • Anyone who wants to start learning Big Data

Prerequisites

  • Basic Database concepts


Course In Detail

Data Warehouse Crash Course

  • In this module, you will learn, what was shortcomings of our traditional Monolithic systems.

  • you will learn how Distributed system is different from Monolithic systems

  • you will learn about Hadoop fundamental understanding and how it is different from RDBMS

  • you will learn 3 main building blocks or components of Hadoop, like the HDFS or Hadoop Distributed File System, the MapReduce programming model for processing and the resource negotiator YARN for cluster management.


[Tags]

Microsoft SQL Server, Azure SQL Server, Azure SQL Data Warehouse, Data Factory, Data Lake, Azure Storage, Azure Synapse Analytics Service, PolyBase, Azure monitoring, Azure Security, Data Warehouse, SSIS

Who this course is for:

  • Database Developer
  • College Students
  • Anyone interested to learn Basic Hadoop concept