Learning Apache Hadoop EcoSystem- Hive

Name: Learning Apache Hadoop EcoSystem- Hive
Rating: 4.0 (1715 reviews)

Learn Apache Hive and Start working with SQL queries which is on Data which is in Hadoop

Created byBalaji M

Last updated 11/2015

English

English [Auto],

What you'll learn

Install and Work on Hive
Troubleshoot Hive Issues
Partition and bucket data

Course content

5 sections • 29 lectures • 4h 17m total length

What is Hive , What was the Motivation and Used Cases4:07
What is Hive ?

Apache Hive is a popular SQL interface for batch processing on Hadoop. Hadoop was built to organize and store massive amounts of data Hive gives another way to access Data inside the cluster in easy, quick way.
What Hive is Not3:16
Hive is not a database; it runs on Hadoop and uses data stored in HDFS. It supports batch processing for OLAP with high latency and no updates or deletes.
Hadoop Recap2:25
Hive Architecture5:29
Different Modes of Hive5:44
Discover Hive's deployment modes: embedded mega-store, local mode, and remote mode, and how the metastore and database are distributed to balance availability and scalability.
Hive Server 2 Concepts and Recap of Section 14:07
Concepts - Quiz

CDH, CM and VM5:57
How to Download VM and Hive Demo19:52
Hive Shell Commands10:57
Explore Hive shell commands and command line interfaces, learn to set parameters, drop properties, manage the current working database, and run Linux and Hive commands from files.
Different Configuration Properties in Hive9:43
Beeswax13:11
Learn how the Beeswax B-Spec application connects Hive queries to a database, detailing architecture, memory allocation, configuration management, and log monitoring.
Install and Configure MySQL Database14:37
Install Hive Server 213:05
Install and configure Hive server 2, connect to the metastore via Beeline, and manage Zookeeper and memory settings for production, including port 10000 and log files.
Hive Quiz -2

Databases in Hive7:48
Learn how to create, describe, and drop databases in Hive, manage namespacing for tables, use if not exists and cascade options, and list or filter databases in the warehouse.
Datatypes in HIve3:36
Explore primitive data types like int, float, double, boolean, and string, and examine complex types such as struct, map, and array. Understand dot notation access and Hive's schema on read.
Schema on Read and Schema on Write3:56
Contrast schema on write and schema on read: traditional databases enforce on load with slower writes, while Hive on Hadoop reads with flexible schema and faster loads.
Download Datasets5:56
Download and unzip movie datasets, transfer data into the distributed file system, and explore a bar-delimited user dataset with MapReduce and Java in the Hadoop ecosystem.
Internal Tables15:13
External Tables11:51
Create external tables in Hive to query data stored in DFS without moving it, by specifying a data location. Dropping external tables leaves underlying data intact, unlike internal tables.
Partition 1A14:14
Explore partitioning in hive by creating partitioned tables, loading data, and querying partitions to improve performance, with examples using gender and country based partitions.
Partition 1B11:23
Bucketing 1A14:32
Explore how bucketing in Hive decomposes data into manageable parts using a hash-based split, contrasting bucketing with partitioning and illustrating bucketed tables and sampling for efficient queries.
Bucketing 1B7:22
Quiz on Tables

Hive In Real Time Projects15:41
Explore roles, capacity planning, and user group permissions in real-time Hive projects, outlining data storage, replication, and schema-based access control.
Auditing in Hive11:01
Troubleshooting Infra issues in Hive11:13
Troubleshooting User issues in Hive5:58
Troubleshoot Hive user issues by validating query syntax against the standard manual, ensuring sample queries run, and resolving permission denied errors through proper group access and session variable management.
Quiz on Troubleshooting

Requirements

64 Bit OS to download VM and work along with videos.

Description

*** This is Course was Created 4 years back. New tutorials will be added based on requirements.***

This tutorial starts with understanding need for hive Architecture and different configuration parameters in Hive. During this course you will learn different aspects of Hive and how it fits as datawarehousing patform on Hadoop. Please subscribe to my Youtube Channel "Hadooparch" for more details.

This Course covers Hive, the SQL of Hadoop.(HQL) We will learn why and How Hive is installed and configured on Hadoop. We will cover the components and architecture of Hive to see how it stores data in table like structures over HDFS data. Understabd architecture, installation and configuration of Hive. We will install and configure Hive server2 and replace postgresql database with mysql. we will also learn how to install mysql and configure it as Hive Metastore

This Course is full of Hive demonstrations. We'll cover how to create Databases, understand data types, create external, internal, and partitioned hive tables, bucketing load data from the local filesystem as well as the distributed filesystem (HDFS), setup dynamic partitioning, create views, and manage indexes and how different layers work together on Hive.

We will go through different roles in implementing in Real time projects, how projects are set up and permissions, Auditing, Troubleshooting.

Finally I will give sample data and queries to work and replicate what has been taught in Videos.

This Course has multiple questions to test your understanding. Kindly attempt all of them.

Who this course is for:

Any one with Basic understanding of Hadoop and basics of SQL

Learning Apache Hadoop EcoSystem- Hive

What you'll learn

Explore related topics

Course content

What? Why ? How Hive Works6 lectures • 25min

Installation , Configuration and Demo on Hive7 lectures • 1hr 27min

Working on Hive10 lectures • 1hr 36min

Hive Implementations in Real Time Projects4 lectures • 44min

Thank you and Project as Exercise2 lectures • 5min

Requirements

Description

Who this course is for: