Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS CompTIA Security+ Microsoft AZ-900
Graphic Design Photoshop Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Personal Development Mindfulness Personal Transformation Life Purpose Meditation CBT Emotional Intelligence
Web Development JavaScript React CSS Angular PHP Node.Js WordPress Vue JS
Google Flutter Android Development iOS Development React Native Swift Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Retargeting
Microsoft Power BI SQL Tableau Business Analysis Data Modeling Business Intelligence MySQL Data Analysis Blockchain
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Business Plan Startup Online Business Freelancing Blogging Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ 2D Game Development Unreal Engine Blueprints Blender
30-Day Money-Back Guarantee
Development Development Tools Apache Kafka

Apache Kafka for Beginners

Learn core Apache Kafka features, create Java, Node.js, Python Producers and Consumers - Full Kafka hands-on experience!
Rating: 4.6 out of 54.6 (224 ratings)
10,783 students
Created by Bogdan Stashchuk
Last updated 2/2021
English
English [Auto]
30-Day Money-Back Guarantee

What you'll learn

  • Understand how Apache Kafka works
  • Create fault-tolerant clusters with topics replication across multiple brokers
  • Apache Kafka Architecture
  • How to create Kafka cluster with multiple Brokers
  • Practice to create producers and consumers using built-in console producer and console consumer
  • Write custom producer and consumer in Java
  • Use Python and Node to produce and consume messages
  • Learn components of the Apache Kafka Cluster

Course content

18 sections • 134 lectures • 8h 38m total length

  • Let's get connected! Join the Learning Community
    00:23

  • Preview01:05
  • Preview00:52
  • Installing Apache Kafka on the Mac
    05:24
  • Installing Ubuntu on MacOS using VirtualBox
    12:40

  • SECTION 2 Introduction
    00:59
  • Creating remote Ubuntu Virtual Private Server
    06:14
  • Installing Apache Kafka on Virtual Private Server
    07:04

  • SECTION 3 Introduction
    01:02
  • Installing Apache Kafka on Windows
    08:25
  • Starting Zookeeper and Kafka server on Windows
    06:31
  • Installing Ubuntu on Windows using VirtualBox
    11:38
  • Installing Apache Kafka on Ubuntu using GUI
    06:15

  • SECTION 4 Introduction
    01:02
  • Observing contents of the Kafka folder
    05:54
  • Reading and editing Kafka files using VisualStudio Code
    06:19
  • Trying to start Kafka Server
    04:10
  • Observing Kafka Server logs
    01:42
  • Starting Zookeeper
    03:11
  • Starting Kafka Server while Zookeeper is up and running
    06:11
  • Observing logs folder and current kafka server setup
    04:43

  • SECTION 5 Introduction
    00:29
  • How to connect to Kafka cluster
    02:18
  • Create new Kafka topic
    05:04
  • What happened after creation of the new topic
    03:35
  • Read details about topic
    05:21

  • SECTION 6 Introduction
    00:43
  • Preview03:12
  • Consuming messages using Kafka Console Consumer
    03:18
  • Consuming messages from the beginning
    01:35
  • Running multiple consumers
    01:30
  • Running multiple producers
    03:13
  • What was changed in the Kafka logs
    09:32

  • SECTION 7 Introduction
    01:35
  • Preview04:00
  • Broker
    02:27
  • Broker cluster
    01:53
  • Zookeeper
    01:58
  • Zookeeper ensemble
    03:29
  • Multiple Kafka clusters
    02:19
  • Default ports of Zookeeper and Broker
    03:48
  • Preview02:31
  • Message structure
    03:33
  • Topics and Partitions
    04:33
  • Spreading messages across partitions
    05:27
  • Partition Leader and Followers
    06:23
  • Controller and it's responsibilities
    05:16
  • How Producers write messages to the topic
    02:14
  • How Consumers read messages from the topic
    03:33

  • SECTION 8 Introduction
    00:45
  • GitHub repository and list of basic Kafka commands
    07:32
  • Diagrams for the course
    03:42

  • SECTION 9 Introduction
    00:52
  • If you use remote Kafka brokers
    00:33
  • Cleaning up existing kafka installation
    02:13
  • Creating topic with multiple partitions
    05:59
  • How messages were spread across different partitions
    06:19
  • Reading messages from specific partition
    02:44
  • Reading messages from specific offset in specific partition
    05:44
  • Reading details about topic and __consumer_offsets topic
    06:45
  • Summary for multiple partitions example
    01:56

Requirements

  • You could have completely no prior knowledge about Apache Kafka
  • Prepare only your Mac, Windows or Linux/Unix computer. Anything will work.
  • Also you could know nothing about Java, Node or Python. I will explain all of these from beginning
  • We will start from the very beginning by installing Apache Kafka and exploring it's components

Description

This course is all about Apache Kafka

Understand HOW Apache Kafka works and learn its core features ON PRACTICE. This is 80% practice course without no useless demos!

Build custom Apache Kafka Producers and Consumers using native Java API. Also you will build projects using APIs for other programming languages like Node.js and Python.

Become a master of Apache Kafka by understanding and practicing its architecture and main features.

All project files and mostly used commands are available in the GitHub repository.

This is the most complete practical Apache Kafka guide here on Udemy that includes tons of practical activities. Most important is that you will learn how Apache Kafka works and knowing it you will be able much more easier use its features and fix mistakes in the future after you'll finish this course. You can have zero knowledge about Apache Kafka, Java, Node.js or Python. All will be taught from scratch, from basic to advanced features. If you want to get deep knowledge of Apache Kafka this course is for you!


We will start by installing Apache Kafka on your computer, VPS (Virtual Private Server) or Virtual Machine on your computer. You will learn that installation of Apache Kafka is pretty easy - you just need to download archive with executable scripts and run them. Also you will learn and practice how to run multiple brokers on the same computer.

Afterwards we will jump into tons of practice activities and use different Apache Kafka features and built-in scripts. You will launch Zookeeper, multiple Brokers, Console Consumer and Console Producer. Also you will test performance of the Kafka Cluster using built-in utility called Performance Monitor.

In practice sections you will perform multiple practice Apache activities:

  1. Create cluster with multiple brokers

  2. Create topic with multiple partitions spread across different brokers

  3. Create topics with replication factor that allows you to store copy of every message on different brokers for redundancy

  4. Produce messages using built-in Console Producer

  5. Consume messages using built-in Console Consumer

  6. Launch multiple consumers in the same consumer group

  7. Launch Performance Monitor for testing Consumers and Producers performance and speed

You will also learn and practice how to use Apache Kafka API to create your own Consumers and Producers

  1. Create Java Maven project

  2. Launch Producer and Consumer using Java

  3. Launch multiple consumers in the same Consumer Group

  4. Understand and practice difference between "subscribe" and "assign"

  5. Create Node.js project

  6. Launch Producers and Consumers using Node.js

  7. Create Python project

  8. Launch Producers and Consumers using Python

During the course you will need to view and edit text files. For that you will NOT use terminal. Instead you will use GUI application VisualStudio Code. Also all configuration files and project files are available in the GitHub repository. This means that during this course you will also learn how to use :

  • Git and GitHub

  • VisualStudio Code

With this course you will get lifetime-long access to more than 100 lectures and tens of practical exercises. After the course you will become a guru of Apache Kafka and will be able easily create custom Apache Kafka Producers and Consumers.

But most important is that you will UNDERSTAND Apache Kafka.

You will also get 30-days money-back guarantee. No questions asked!

Don't wait and join the course now!

Who this course is for:

  • Beginners who want to learn Apache Kafka
  • Advanced Apache Kafka users who want to learn how to build producers and consumers in other languages like Node or Python
  • This course is for you if you want to PRACTICE using Kafka and it's APIs

Featured review

Minaxi Shantaram Hivaraye
Minaxi Shantaram Hivaraye
32 courses
4 reviews
Rating: 5.0 out of 512 months ago
From 2 weeks I'm searching for the material on python kafka and my search end here... The course is full of practical aspects and demo.The course cover kafka from scratch. And the trainer is so prompt within a hour i had replies for my queries. Thanks Bogdan!

Instructor

Bogdan Stashchuk
Software Engineer, CCIE #22608, MBA, PhD - stashchuk.com
Bogdan Stashchuk
  • 4.7 Instructor Rating
  • 7,503 Reviews
  • 178,957 Students
  • 15 Courses

Do you really want to understand and practice instead of sitting and watching long presentations or trying to code along without any clue what is happening behind the scenes?

Join me in any of my courses and you will get real knowledge based on the deep understanding of every single topic.

But who am I?

My name is Bogdan Stashchuk and I teach students more than 20 years. I am working as Software Engineer and love to teach and learn myself.

I have a huge experience in explaining difficult things in an easy to understand format backed up with practice activities. That is the perfect combination that enables you to really learn and retain gained knowledge for a long period of time.

Let's connect in the Social Networks! All links you could find under the profile picture.

See you on my courses!

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Impressum Kontakt
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.