
Hive Introduction
Hive Installation
Hive Setup : database setup /schema setup / thrift server setup
How hive works ?
Create Hive Schema in Mysql database / Hive warehouse on Hadoop
Configure Thrift server
Start Hive shell and create a database
Managed / External Table
Load data files in Hive Table from local or hdfs file system
Drop table / DB
Table Properties
Read type of files : csv, text , parquet , avro , json
Write hive table with Format using serde : parquet / avro / csv / avro
Serde library usage to read json /csv/ xml files in Hive and dump into table
Compression in hive : snappy / gzip / bzip2
Partition in Hive
Static / Dynamic
Bucketing in Hive
Order by
Sort by , Distribute by
Clustered by
Group by
Update in Hive
Delete in Hive
Merge Statement in hive
rank
dense_rank
row_number
Sampling Data : Random sampling, Block Sampling
Materialized View
Types of Join
Left/right /inner / full outer join
Left Semi Join
Performance Improvement technique
Map Side Join / Broadcast Join
Performance Improvement technique
Map Side Join / Broadcast Join
Bucket Map Join
Sort Merge Bucketing Join
Tricks to make any Hive query run fastest in real time projects
Parameters to be used to optimize join query execution
Decide bucketing and partitioning column in a table
Hive Execution Engine : MR / Spark / MR3 / Tez
Hive Code / SQL Review Checklist : attached in resources
Consume attached website logs , you can create copy of it , and dump into Hive tables
How to consume data continuously and dump into hive table with automation
Make meaningful information from apache log server of website and analyze results.
Take business decision based on query results
Apache Hive is a data processing tool on Hadoop. It is a querying tool for HDFS and the syntax of it's queries is almost similar to our old SQL. Hive is an open source-software that lets programmers analyze large data sets on Hadoop.
Benefits of this course:
Enroll into this course and get end to end knowledge of Basic + ADVANCE Hive + Interview asked Use cases. This course is very rare of its kind and includes even very thin details of Hive which are not available anywhere online.
In this course you will get to understand a step by step learning of very Basic Hive to Advance Hive (which is actually used in Real-time projects) like with latest Hive version 3.x
Hive Setup , All file formats of Hive , Partition , Bucketing , Joins , Hive Code Review like Experts : all demo / interactive sessions
HQL Clauses : Distribute by , order by , clustered by , sort by
Window functions like rank , row_number , dense_rank : all demo / interactive sessions
Materialized View : A new advanced feature of Hive
ACID properties : update , delete , merge records in Hive table
CRUD operation in Hive : Different ways to create / insert data in hive table
Exchange of Partition between Tables and much more...
Performance Technique that big companies use to query fast on data.
This course is a full package explaining even rarely used commands and concepts in Hive. After completing this course you won't find any topic left in Hive. This course is made keeping in mind the Real Implementation of Hive in Live Projects..
Additionally ,You can download the Step Step Installation Guide (doc) to Install Hadoop and Apache Hive