Apache Kafka Complete Developer's Guide
4.6 (60 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
9,818 students enrolled

Apache Kafka Complete Developer's Guide

Learn core Apache Kafka features, create Java, Node.js, Python Producers and Consumers. Full Kafka hands-on experience!
4.6 (60 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
9,818 students enrolled
Created by Bogdan Stashchuk
Last updated 6/2020
English
English [Auto-generated]
Current price: $69.99 Original price: $99.99 Discount: 30% off
5 hours left at this price!
30-Day Money-Back Guarantee
This course includes
  • 8.5 hours on-demand video
  • 4 articles
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  • Understand how Apache Kafka works
  • Create fault-tolerant clusters with topics replication across multiple brokers
  • Apache Kafka Architecture
  • How to create Kafka cluster with multiple Brokers
  • Practice to create producers and consumers using built-in console producer and console consumer
  • Write custom producer and consumer in Java
  • Use Python and Node to produce and consume messages
  • Learn components of the Apache Kafka Cluster
Course content
Expand all 133 lectures 08:38:10
+ Apache Kafka Installation Overview
4 lectures 20:01

This lecture I'll briefly overview set-up of Apache Kafka on different computers

Preview 01:05
Installing Apache Kafka on the Mac
05:24
Installing Ubuntu on MacOS using VirtualBox
12:40
+ Installing Apache Kafka on the remote Ubuntu server
3 lectures 14:17
SECTION 2 Introduction
00:59
Creating remote Ubuntu Virtual Private Server
06:14
Installing Apache Kafka on Virtual Private Server
07:04
+ Installing Apache Kafka on Windows
5 lectures 33:51
SECTION 3 Introduction
01:02
Installing Apache Kafka on Windows
08:25
Starting Zookeeper and Kafka server on Windows
06:31
Installing Ubuntu on Windows using VirtualBox
11:38
Installing Apache Kafka on Ubuntu using GUI
06:15
+ Starting Apache Zookeeper and Kafka Broker
8 lectures 33:12
SECTION 4 Introduction
01:02
Observing contents of the Kafka folder
05:54
Reading and editing Kafka files using VisualStudio Code
06:19
Trying to start Kafka Server
04:10
Observing Kafka Server logs
01:42
Starting Zookeeper
03:11
Starting Kafka Server while Zookeeper is up and running
06:11
Observing logs folder and current kafka server setup
04:43
+ Creating and exploring Kafka Topic
5 lectures 16:47
SECTION 5 Introduction
00:29
How to connect to Kafka cluster
02:18
Create new Kafka topic
05:04
What happened after creation of the new topic
03:35
Read details about topic
05:21
+ Producing and consuming Messages
7 lectures 23:03
SECTION 6 Introduction
00:43
Consuming messages using Kafka Console Consumer
03:18
Consuming messages from the beginning
01:35
Running multiple consumers
01:30
Running multiple producers
03:13
What was changed in the Kafka logs
09:32
+ What is Apache Kafka and how it works
16 lectures 54:59
SECTION 7 Introduction
01:35
Broker
02:27
Broker cluster
01:53
Zookeeper
01:58
Zookeeper ensemble
03:29
Multiple Kafka clusters
02:19
Default ports of Zookeeper and Broker
03:48
Message structure
03:33
Topics and Partitions
04:33
Spreading messages across partitions
05:27
Partition Leader and Followers
06:23
Controller and it's responsibilities
05:16
How Producers write messages to the topic
02:14
How Consumers read messages from the topic
03:33
+ GitHub Repository and Diagrams for the course
3 lectures 11:59
SECTION 8 Introduction
00:45
GitHub repository and list of basic Kafka commands
07:32
Diagrams for the course
03:42
+ EXAMPLE 1 - Topic with Multiple Partitions
9 lectures 33:05
SECTION 9 Introduction
00:52
If you use remote Kafka brokers
00:33
Cleaning up existing kafka installation
02:13
Creating topic with multiple partitions
05:59
How messages were spread across different partitions
06:19
Reading messages from specific partition
02:44
Reading messages from specific offset in specific partition
05:44
Reading details about topic and __consumer_offsets topic
06:45
Summary for multiple partitions example
01:56
+ EXAMPLE 2 - Kafka Cluster with Multiple Brokers
11 lectures 33:31
SECTION 10 Introduction
00:57
Example overview - run multiple brokers
01:25
Creating separate configuration files for brokers
05:34
Launching three brokers
02:40
Getting cluster information and broker details from Zookeeper
02:47
Creating multiple-partition topic in the Kafka cluster
03:16
Looking at logs folders of every broker
02:13
Producing and consuming messages in the cluster
03:33
Details about topic in the cluster
03:27
Simulating broker failure in the cluster
05:54
Summary for broker cluster and topic without replication
01:45
Requirements
  • You could have completely no prior knowledge about Apache Kafka
  • Prepare only your Mac, Windows or Linux/Unix computer. Anything will work.
  • Also you could know nothing about Java, Node or Python. I will explain all of these from beginning
  • We will start from the very beginning by installing Apache Kafka and exploring it's components
Description

This course is all about Apache Kafka

Understand HOW Apache Kafka works and learn its core features ON PRACTICE. This is 80% practice course without no useless demos!

Build custom Apache Kafka Producers and Consumers using native Java API. Also you will build projects using APIs for other programming languages like Node.js and Python.

Become a master of Apache Kafka by understanding and practicing its architecture and main features.

All project files and mostly used commands are available in the GitHub repository.

This is the most complete practical Apache Kafka guide here on Udemy that includes tons of practical activities. Most important is that you will learn how Apache Kafka works and knowing it you will be able much more easier use its features and fix mistakes in the future after you'll finish this course. You can have zero knowledge about Apache Kafka, Java, Node.js or Python. All will be taught from scratch, from basic to advanced features. If you want to get deep knowledge of Apache Kafka this course is for you!


We will start by installing Apache Kafka on your computer, VPS (Virtual Private Server) or Virtual Machine on your computer. You will learn that installation of Apache Kafka is pretty easy - you just need to download archive with executable scripts and run them. Also you will learn and practice how to run multiple brokers on the same computer.

Afterwards we will jump into tons of practice activities and use different Apache Kafka features and built-in scripts. You will launch Zookeeper, multiple Brokers, Console Consumer and Console Producer. Also you will test performance of the Kafka Cluster using built-in utility called Performance Monitor.

In practice sections you will perform multiple practice Apache activities:

  1. Create cluster with multiple brokers

  2. Create topic with multiple partitions spread across different brokers

  3. Create topics with replication factor that allows you to store copy of every message on different brokers for redundancy

  4. Produce messages using built-in Console Producer

  5. Consume messages using built-in Console Consumer

  6. Launch multiple consumers in the same consumer group

  7. Launch Performance Monitor for testing Consumers and Producers performance and speed

You will also learn and practice how to use Apache Kafka API to create your own Consumers and Producers

  1. Create Java Maven project

  2. Launch Producer and Consumer using Java

  3. Launch multiple consumers in the same Consumer Group

  4. Understand and practice difference between "subscribe" and "assign"

  5. Create Node.js project

  6. Launch Producers and Consumers using Node.js

  7. Create Python project

  8. Launch Producers and Consumers using Python

During the course you will need to view and edit text files. For that you will NOT use terminal. Instead you will use GUI application VisualStudio Code. Also all configuration files and project files are available in the GitHub repository. This means that during this course you will also learn how to use :

  • Git and GitHub

  • VisualStudio Code

With this course you will get lifetime-long access to more than 100 lectures and tens of practical exercises. After the course you will become a guru of Apache Kafka and will be able easily create custom Apache Kafka Producers and Consumers.

But most important is that you will UNDERSTAND Apache Kafka.

You will also get 30-days money-back guarantee. No questions asked!

Don't wait and join the course now!

Who this course is for:
  • Beginners who want to learn Apache Kafka
  • Advanced Apache Kafka users who want to learn how to build producers and consumers in other languages like Node or Python
  • This course is for you if you want to PRACTICE using Kafka and it's APIs