
Walkthrough of course structure which is covering Kafka basics, setup, building clients and pre-requisites before starting the course.
Event streaming and use cases, Kafka introduction and its properties.
What are Kafka Topics and Partitions and how the data is written and read from Kafka.
What is a Kafka broker, cluster, bootstrap broker/server and how partitions are assigned to brokers in a cluster?
Understand what is partition replication, replication factor, leader and ISR, leader selection and zookeeper.
Summarizing concepts of Kafka basics.
Learn what are Producers, how producers write data when message key is present and when not present.
Learn what is Producer Acknowledgement and its different modes.
Learn what are consumers and consumer-groups.
Learn what are consumer offsets and how Kafka manages them.
See the introduction of Kafka setup on single machine.
Learn how to install open JDK-8, download Kafka and setup Kafka on Linux.
Learn how to start Zookeeper and Broker (Kafka server) on Linux.
Learn how to download Kafka and setup Kafka on Windows.
Learn how to start Zookeeper and Broker (Kafka server) on Windows.
Learn CLI commands to create, list, describe and delete a topic
Learn how to write data to Kafka Topic using Kafka console producer.
Learn how to read data from Kafka Topic using Kafka console consumer.
Learn how to create consumers within groups using Kafka console consumer command.
Learn how to check consumer group offsets and change/reset offsets.
Learn to setup Java project for Kafka clients
Learn to create Kafka producer in Java
Add call-back to the Kafka producer to get metadata information.
Learn to add key to the producer record and Kafka distribution behavior for messages with the keys.
Learn to create Kafka consumer in Java
Learn how consumers behave within a group
Learn how to assign a specific partition to a consumer
This course is Kafka basics course and is for Kafka beginners.
This course covers all the basic concepts of Kafka like:
What is event streaming?
What is Kafka and what are its industry use cases?
Kafka components like - Topic, Partitions, Offsets etc.
What are producers and how they write data to Kafka.
What are consumers and how they read data from Kafka.
What is a consumer group?
Architecture of Kafka.
What is a zookeeper?
What is a broker?
Partition distribution and replication in distributed architecture.
How to setup Kafka locally on your machine:
Download and setup Kafka on Linux.
Configure properties files and Start Kafka servers (zookeeper and broker) on Linux.
Download and setup Kafka on Windows.
Configure properties files and Start Kafka servers (zookeeper and broker) on Windows.
How to use Kafka CLI:
Create topics using CLI - set partition and replication-factor
Create producers using CLI and write data to Kafka topic
Create consumers using CLI and read data from Kafka topic
Create consumer group using CLI
Finally learn how to develop Kafka clients in Java:
Develop Kafka producer in Java which will write data to Kafka.
Write data to Kafka in Key-Value pair using producer.
Develop Kafka consumer in Java which will read data from Kafka.
Run multiple consumers in a group and observe the behavior.
By the end of the course you will be comfortable in Kafka basics and will have a good understanding of how to create your own Kafka producers and consumers.