Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS CompTIA Security+ AWS Certified Developer - Associate
Graphic Design Photoshop Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Personal Development Mindfulness Personal Transformation Life Purpose Meditation Emotional Intelligence Neuroscience
Web Development JavaScript React CSS Angular PHP WordPress Node.Js Python
Google Flutter Android Development iOS Development Swift React Native Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Google Analytics
SQL Microsoft Power BI Tableau Business Analysis Business Intelligence MySQL Data Analysis Data Modeling Big Data
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Online Business Business Plan Startup Freelancing Blogging Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ 2D Game Development Unreal Engine Blueprints Blender
2021-02-03 10:39:26
30-Day Money-Back Guarantee
IT & Software Other IT & Software Big Data

Big Data For Architects

Build Big Data Pipelines using Hadoop, Spark, NiFi, Kafka etc.
Highest Rated
Rating: 4.6 out of 54.6 (32 ratings)
208 students
Created by Bhavuk Chawla
Last updated 7/2020
English
English [Auto]
30-Day Money-Back Guarantee

What you'll learn

  • Gain Holistic Picture of Big Data Ecosystem
  • Experience Classroom like environment via White-boarding sessions
  • Understand Big Data Architectures and Pipelines
  • Build End to End Big Data Batch and Streaming Pipelines
  • Understand which Big Data Technology to choose when?
  • Perform hands-on on Google Cloud DataProc Pseudo Distributed (Single Node) Environment

Requirements

  • Knowledge equivalent to our Big Data Crash Course
  • Credit card for setting up GCP account (no charges will be deducted if using GCP trial version). You can perform all exercises of this course without incurring charges. Please refer “GCP Account Best Practices” Section for more details.

Description

  • Full of Whiteboarding Sessions to provide you Classroom like experience

  • Understand thought process in choosing Big Data Ingestion, Storage, Processing and Analysis related Technologies

  • Focus on Key Architectures and Pipelines in Big Data Ecosystem

  • Which Big Data Technology to choose when?

  • Covering Breadth of Big Data Technologies

  • Hands-on on Google Cloud DataProc Pseudo Distributed Cluster

  • Theory is more but relevant to provide you right information to work with Real World Big Data Projects

  • No need to pay for running labs on Google Cloud

Below are our more courses -

  1. Big Data Crash Course | Learn Hadoop, Spark, NiFi and Kafka

  2. Big Data For Architects | Build Big Data Pipelines and Compare Key Big Data Technologies

  3. Google Data Engineer Certification Practice Exams

  4. Setup Single Node Cloudera Cluster on Google Cloud

  5. Confluent Certified Operator for Apache Kafka Practice Test

  6. Confluent Certified Developer Apache Kafka Practice Tests

You may join our YouTube Channel named "DataCouch" for getting access to interesting videos free of cost.

We are also an official training delivery partner of Confluent Kafka.. We conduct corporate trainings on various topics including Confluent Kafka Developer, Confluent Kafka Administration, Confluent Kafka Real Time Streaming using KSQL & KStreams and Confluent Kafka Advanced Optimization. Our instructors are well qualified and vetted by Confluent for delivering such courses.

Please feel free to reach out if you have any requirements for Confluent Kafka Training for your team. Happy to assist.

Who this course is for:

  • Engineers who are aiming to get a job in Big Data
  • Engineers who would like to transition their roles into Big Data Technologies
  • Big Data Engineers planning to appear for Certifications like CCA175, CCA159
  • Big Data Engineers who are looking for Promotion :)

Course content

10 sections • 68 lectures • 7h 44m total length

  • Preview01:58
  • Preview02:09
  • Preview01:50
  • Preview02:34

  • Google Cloud Account Setup
    01:39
  • Creating a Data Proc Cluster
    12:47
  • GCP Account Best Practices
    02:55

  • Preview20:00
  • Evolution of Big Data Technologies
    11:15
  • Key Big Data Architectures
    12:57
  • Typical Big Data Batch Pipeline
    02:13
  • Typical Big Data Streaming Pipeline
    08:31
  • Example 01: Big Data Streaming Pipeline
    02:41
  • Example 02: Big Data Streaming Pipeline
    03:09

  • Factors to consider while comparing Ingestion frameworks
    12:18
  • Kafka vs Flume
    10:54
  • NiFi vs Kafka
    12:58
  • Sqoop vs Flume
    06:12
  • Sqoop vs Kafka Connect
    06:33
  • Hands-on NiFi Installation
    07:11
  • Hands-on NiFi Installation
    00:39
  • Preview07:39
  • Hands-on Kafka Installation
    00:32
  • Hands-on Kafka and NiFi Integration Background
    01:41
  • Hands-on Kafka and NiFi Integration
    24:10

  • Factors to consider while comparing Storage frameworks
    09:16
  • HDFS vs HBase
    06:18
  • HBase vs Kudu
    05:25
  • HDFS vs Kudu
    04:03
  • HBase vs Cassandra
    07:27

  • Text vs Binary
    03:29
  • Interoperability
    02:11
  • Row Oriented vs Column Oriented
    06:43
  • Splittable Formats
    05:15
  • Schema Evolution
    09:34
  • Comparing Data Formats
    08:28
  • Hands-on Sqoop Installation on Dataproc Cluster
    11:49
  • Hands-on Sqoop Installation on Dataproc cluster
    01:39
  • Hands-on Big Data Batch Pipeline Use Avro Format
    17:47

  • Factors to consider while comparing Processing frameworks
    13:16
  • MR vs Spark Logical Architecture Perspective
    07:17
  • MR vs Spark Performance Perspective
    01:29
  • Spark vs Tez
    04:23
  • Spark vs Flink
    10:47
  • Kafka Streams vs Spark Streaming
    10:31
  • Spark 2.x Streaming vs Spark 1.x Streaming
    05:39
  • Spark Core vs Spark SQL
    04:21
  • Hands-on Kafka & Spark Streaming Integration
    12:01
  • Hands-on Kafka & Spark Streaming Integration
    01:11

  • Factors to consider while comparing Analysis frameworks
    10:23
  • Hive vs Impala
    07:09
  • Hive vs Pig
    05:49
  • Hive vs Spark SQL
    04:42
  • Hive vs Hive LLAP vs Impala
    06:49
  • Hive vs KSQL
    06:22
  • KSQL vs KSQLDB
    04:47
  • Hands-on KSQL
    05:55
  • Hands-on KSQL
    00:42
  • Hands-on Write to a Stream and Table using KSQL
    12:24
  • Hands-on Write to a Stream and Table using KSQL
    01:42
  • Hands-on Streaming ETL Pipeline Background
    06:09
  • Hands-on Build a Scalable ETL Pipeline with Kafka Connect - part 1
    17:31
  • Hands-on Build a Scalable ETL Pipeline with Kafka Connect - part 2
    03:53

  • Solr vs ElasticSearch
    07:00
  • Cloudera Search vs Solr
    02:47
  • Oozie vs Airflow
    04:52
  • KSQL vs KStreams
    06:55

  • Conclusion
    01:10

Instructor

Bhavuk Chawla
Authorized Instructor for Google, Cloudera, Confluent
Bhavuk Chawla
  • 4.3 Instructor Rating
  • 509 Reviews
  • 10,662 Students
  • 8 Courses

Bhavuk has over 16 years of experience in IT, more than 8 years of experience implementing Cloud/ML/AI/Big Data Science related projects. He is an official instructor for Google, Confluent, and Cloudera. He has delivered and continues to deliver his training sessions in various companies like Google Singapore, Microsoft Bangalore, Starbucks Coffee Seattle, Adobe India, and EMEA Region, etc.

He was recognized by Cloudera as the Instructor of the Year 2016 (APAC) for his exceptionally high ratings received in various training sessions. Connect with him on LinkedIn for Long term Learning partnership.

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.