Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS CompTIA Security+ AWS Certified Developer - Associate
Graphic Design Photoshop Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Mindfulness Personal Development Personal Transformation Meditation Life Purpose Coaching Neuroscience
Web Development JavaScript React CSS Angular PHP WordPress Node.Js Python
Google Flutter Android Development iOS Development Swift React Native Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Retargeting
SQL Microsoft Power BI Tableau Business Analysis Business Intelligence MySQL Data Analysis Data Modeling Data Science
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Online Business Business Plan Startup Freelancing Blogging Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ 2D Game Development Unreal Engine Blueprints Blender
30-Day Money-Back Guarantee

This course includes:

  • 2 hours on-demand video
  • 8 articles
  • 18 downloadable resources
  • Full lifetime access
  • Access on mobile and TV
Development Development Tools Big Data

Big Data Internship Program - Data Processing - Hive and Pig

Provide higher-level language to facilitate large-data processing.
Rating: 4.4 out of 54.4 (34 ratings)
758 students
Created by Big Data Trunk
Last updated 1/2017
English
English [Auto]
30-Day Money-Back Guarantee

What you'll learn

  • Have excellent understanding of Apache Hive and Pig tool with hands-on experience .
  • Understand the working of a project in real-world scenario.
  • Work experience in end-to-end Project ( Data Masking) and can mention in Resume .

Course content

5 sections • 34 lectures • 2h 13m total length

  • Preview02:04
  • Introduction to Data processing
    05:23

  • Preview02:58
  • Hive Introduction
    03:24
  • Hive Introduction
    4 questions
  • Hive Architecture
    04:26
  • Hive Architecture
    4 questions
  • DataTypes in Hive
    03:07
  • Managed table and External table in Hive
    01:51
  • Manage and external tables in hive
    2 questions
  • Demonstrating difference between Internal and external table
    08:00
  • Demonastrating diffrent between external and interrnal
    3 questions
  • Hands on Lab Hive External Vs InternalTable
    01:06
  • Partitions in Hive with demo
    08:25
  • Hands on Lab Hive Partition
    00:33
  • Partition in hive
    5 questions
  • HIve Dynamic Partitioning
    03:42
  • Hands on Lab HIve Dynamic Partitioning
    00:48
  • Hive dynamic Partition
    3 questions

  • What is Apache PIG?
    Preview04:37
  • PIG Architecture
    02:02
  • Pig Data Types
    03:18
  • Pig Data Types
    3 questions
  • Pig Latin
    06:07
  • Pig Latin
    3 questions
  • PIG Running Modes
    03:40
  • PIG Running Modes
    4 questions
  • PIG Operators
    07:03
  • PIG Operators
    4 questions
  • PIG Wordcount example
    03:18
  • Pig Wordcount lab
    00:34

  • BookRecommendationProject
    05:13
  • BookRecommendationProject-2
    08:12

  • Preview03:42
  • Data Masking Project Solution Design
    03:19
  • Data Masking Project Solution Walkthrough
    09:05
  • DataMaskingProject-step1(Create tables inMySql)
    05:41
  • Hands on Lab DataMaskingProject-step1-Document
    01:48
  • Step2:Creating and importing data in hive external tables
    03:40
  • Hands on Lab DataMaskingProject-step2- Document
    00:55
  • Step3:Creating UDFs in Java
    06:36
  • Hands on Lab DataMaskingProject-step3(udf)- Document
    02:20
  • Step4:Exporting data to MySql in masked database
    05:34
  • Hands on Lab DataMaskingProjectStep4 - Document
    01:19

Requirements

  • Should know the basics of BigData concepts like-HDFS,MapReduce and some knowledge of RDBMS.
  • Should take our Part-1 free course (Big data Internship Program - Foundation) to understand these concepts better. (Not mandatory but desirable).
  • Should take our Part-1 free course (Big data Internship Program - ingestion ) to understand sqoop and flume. ( For our Book Recommendation Project only).

Description

This course is part of “Big data Internship Program”  which is aligned to a typical Big data project life cycle stage.

  • Foundation
  • Ingestion
  • Storage
  • Processing
  • Visualization

This course is focused on Data Processing in Big data.This course is suitable for developers, data analysts and business analysts. Experience with SQL and scripting languages is recommended, but is not required. 

You will learn 

  • Understanding of Hive core concept and architecture.
  • How to create and manipulate tables using Hive.
  • Advanced features of Hive.
  • Hive Best Practices
  • Performing real-time, complex queries on datasets
  • Pig’s Architecture
  • Reading and Writing Data with Pig
  • Pig Best Practices

Project work -

  1. Provide Data in Hive and manipulate the data for Our Book Recommendation project. 
  2. One Ad-on project -- Data Masking with hive and sqoop

Who this course is for:

  • This course is for anyone who wants to learn about Hive and Pig in details with hand exprience.
  • Students who want to do internship.
  • Big Data Analytics Professional.
  • Developers who want to get clear concept .

Instructor

Big Data Trunk
All about Big Data and Hadoop
Big Data Trunk
  • 4.0 Instructor Rating
  • 2,106 Reviews
  • 45,087 Students
  • 8 Courses

Big Data Trunk is the leading Big Data focus consulting and training firm founded by industry veterans in data domain. It helps is customer gain competitive advantage from open source, big data, cloud and advanced analytics. It provides services like Strategy Consulting, Advisory Consulting and high quality classroom individual and corporate training.

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.