Udemy Business

Teach on Udemy

Turn what you know into an opportunity and reach millions around the world.

Learn More

Your cart is empty.

Keep shopping

Apache Kafka for Beginners - Learn Kafka by Hands-On

Name: Apache Kafka for Beginners - Learn Kafka by Hands-On
Rating: 4.6 (1233 reviews)

Deep dive in to Apache Kafka concepts and learn to build Kafka producers/consumers using Java.

Created byPragmatic Code School

Last updated 2/2026

English

What you'll learn

Understand all the Kafka concepts and Kafka core internals.
Learn Kafka internals through practice
Build Kafka Producer applications using Java
Learn the Kafka Producer Techniques for reliable data delivery
Build Kafka Consumer applications using Java
Advance Kafka Consumer Techniques to handle duplicate processing of records
Consumer Rebalance and different techniques to handle them
Consumer techniques to seek to a specific offset
Learn to build Custom Serializer and Deserializer in Kafka
By the end of the course you will have a complete understanding of Apache Kafka and build Kafka consumer applications using Java

Course content

15 sections • 57 lectures • 4h 52m total length

Course Introduction & Objectives1:48
In this lecture, I will give you all an introduction and objectives for this course.
Pre-Requesities1:12
In this lecture, I will cover the pre-requisites thats needed to enroll in this course.

Kafka Topics and Partitions - Theory5:00
In this lecture, we will learn in detail about the Kafka topics, partitions.
Set Up a ZooKeeper/Kafka Broker in Local5:48
In this lecture, we will set up the Zookeeper and Kafka broker in local.
Create Topic, Produce and Consume Messages using the Command Line Interface(CLI)5:14
In this lecture, we will learn about creating a topic , produce messages and consume messages from a Kafka Topic.
Produce and Consume Messages with Key6:39
In this lecture, we will learn about producing and consuming messages with key using the command line interface.
Consumer Offsets4:02
In this lecture, we will learn about consumer offsets how it plays a major role in keeping a record of resuming processing the records from where it left off in the topic.
Consumer Groups7:55
In this lecture, we will learn about consumer groups and how it plays a major role in scalable message consumption.
Commit Log and Retention Policy8:11
In this lecture, we will learn about the partitioned commit log and retention policy of any record thats written in to Kafka.
Kafka as a Distributed Streaming System4:15
Kafka as a Distributed Streaming SystemIn this lecture, I will explain in detail about how does Kafka behaves as a Streaming System.
Setting up a Kafka Cluster in Local with 3 Kafka Brokers9:54
In this lecture, we will set up a Kafka Cluster with 3 brokers to simulate a production like environment.
How Kafka Cluster distributes the Client Requests ? - Leader/Follower5:48
In this lecture, we will learn about how kafka distributes the request between the available brokers.
How Kafka handles Data Loss ? - Replication and In-Sync-Replica(ISR)9:08
In this lecture, we will learn about replication and In sync Replicas ISR.
Fault Tolerance and Robustness in Kafka2:39
In this lecture, we will learn about the fault tolerance and robustness in Kafka.

Project SetUp7:09
In this lecture, we will set up the base Kafka Project for the Kafka Producer.
Sending Messages using Producer API3:44
In this lecture, we will learn about the different options that are available with respect to sending messages into the Kafka Topic.
Build Kafka Producer - Send Messages Synchronously15:17
In this lecture, we will code the producer using the Kafka Producer.
Add Logging using LogBack8:26
In this lecture, we will add logging in to our application using LogBack.
Sending Messages Asynchronously6:49
In this lecture, we will code the Kafka Producer to publish the record in to Kafka asynchronously.
Send Messages with Key3:41
In this lecture, we will code the producer to send the messages with key.
Programmatic Interface to Produce Messages6:59
In this lecture, we will build a simple command line interface Java interface to produce messages.
Kafka Producer API - Behind the Scenes4:16
In this lecture, we will learn about the different layers the producers API goes through before the message is produced to Kafka

Kafka Producer API - Guaranteed Message Delivery Configurations2:46
In this lecture, we will learn about the different configurations that guarantee message delivery in to Kafka.
Configuring acks and min.insync.replicas - Hands On7:50
In this lecture, we will override the acks value and explore the behavior of the Kafka Producer
Configuring retries and retry.backoff.ms - Hands On4:06
In this lecture, we will override the retries and retry.backoff.ms value and explore the behavior of the Kafka Producer

Project SetUp1:53
In this lecture, we will set up the consumers module to build the Kafka consumer application.
Consuming Messages using Consumer API - poll() loop3:19
In this lecture, we will learn about how to read messages using the consumer API and its behavior behind the scenes.
Build Kafka Consumer using the Consumer API13:48
In this lecture, we will code the Kafka consumer to read the messages from the Kafka Topic.
auto.offset.reset - earliest vs latest4:17
In this lecture, I will show a demo on the behavior of the consumer based on the auto.offset.reset value.

Scaling the Consumer using Consumer Groups5:45
In this lecture, we will create another consumer and explore the behavior of consumer groups.
Consumer Rebalance3:47
In this lecture, we will learn about the consumer rebalance and its importance in Kafka Consumer.
Consumer Rebalance & max.poll.interval.ms4:16
In this lecture, we will learn about the importance of the max.poll.interval.ms and its impact on consumer rebalance.

Requirements

Basic commands in Unix/Windows Platform.
Basic Java Knowledge.
Basics of Windows/Mac Platform

Description

Description:

Learn the fundamentals and advanced concepts of Apache Kafka in this course. This course will give you a good understanding of all the concepts through Hands-On

This course will walk you through the Kafka concepts step by step
All the Kafka concepts will be taught through Hands-On
This course will increase your technical expertise in Kafka
This course will give you good exposure to build Kafka Client applications using Java
This course will be an eyeopener for people who think Kafka is a complex system and you will find yourself in a better place after you complete this course
This course will transfer you from no Kafka experience to an experienced Kafka user.

Course Overview:

Getting Started with Kafka

In this section, I will give you all a quick introduction to Apache Kafka, terminologies and different client APIs that are part of Kafka

Download and Install Kafka

In this section, we will download the Kafka distribution from the Kafka Website.

Understanding Kafka Components and its Internals - (Theory + Hands-On)

In this section, we will explore the Kafka internals from a theoretical perspective followed by hands-on exploring the Kafka internals.

Learn about the Topics and Partitions in Kafka
Setup a Local Kafka Cluster with Multiple Brokers
Producer/Consumer messages in the Kafka Cluster
Learn about Consumer Offsets and Consumer Groups
Commit Log and Retention Policy
Learn about Kafka Load Distribution and Fault Tolerance and Robustness

Kafka Producer API - Hands-On

In this section, we will learn about building the Kafka Producer to producer messages into Kafka using the producer API

Setting up the base-project for Producer
Understand how the producer API works
Produce messages to the Kafka topic using the Synchronous/Asynchronous approach
Understand how Kafka producer API works behind the scenes

Kafka Producer API - Guaranteed Message Delivery Configurations

In this lecture, we will learn about the different configurations that guarantee message delivery into Kafka.

Explore some of the producer API Configurations
Configuring the acks and min.insync.replicas for guaranteed message delivery
Override the retries and retry-back-off-ms value\

Kafka Consumer API - Hands On

In this section, we will learn about building Kafka consumers to read messages from Kafka using the Consumer API.

Setting up the base-project for Consumers
Consuming Messages using Consumer API - poll() loop
Build Kafka Consumer using the Consumer API
auto.offset.reset - earliest vs latest

Consumer Groups & Consumer Rebalance

In this section, we will learn about Consumer Groups and Consumer rebalance.

Scaling the Consumer using Consumer Groups
Consumer Rebalance
Consumer Rebalance & max-poll-interval-ms

Consumer Offsets - Default and Manual Offset Management - Hands-On

Committing Offsets - Default Offset Commit Strategy
Manually Committing Offsets
Committing Offsets Synchronously - using commitSync()
Committing Offsets Asynchronously - using commitAsync()
Committing Specific Offsets - using CommitSync()

By the end of this, you will have a complete understanding of how Apache Kafka works and how to build Kafka client applications using Producer and Consumer API.

Who this course is for:

Any one who is willing to learn about Kafka.

Apache Kafka for Beginners - Learn Kafka by Hands-On

What you'll learn

Explore related topics

Course content

Getting Started with Course2 lectures • 3min

Course Slides1 lecture • 1min

Getting Started with Kafka2 lectures • 9min

Download and Install Kafka1 lecture • 4min

Source Code for this Course1 lecture • 1min

Understanding Kafka Components and its Internals - (Theory + Hands On)12 lectures • 1hr 15min

Kafka Producer API - Hands On8 lectures • 56min

Kafka Producer API - Guaranteed Message Delivery Configurations3 lectures • 15min

Kafka Consumer API - Hands On4 lectures • 23min

Consumer Groups & Consumer Rebalance - Hands On3 lectures • 14min

Requirements

Description

Who this course is for: