The Complete Apache Kafka course for beginners

Explore how a messaging system transfers data between applications, handles large data volumes, and provides reliable messages with point-to-point queues or publish-subscribe topics (producers, publishers, subscribers).

Explore Apache Kafka’s high throughput for publishing and subscribing, durable and reliable storage, scalability, and use cases like log aggregation and stream processing with Storm and Spark.

Learn the basics of Apache Kafka, including topics, partitions, replication, and how producers and consumers interact to publish data and balance load across a cluster.

Learn Kafka fundamentals and terminology, including topics, partitions, offsets, replicas, brokers, and clusters, and how immutable message sequences are stored and replicated.

Explore the Kafka architecture, where producers publish to brokers and partitions, consumers pull from topics, leaders and followers handle fault tolerance, and Zookeeper manages cluster state.

Discover how producers publish messages to topic partitions, how Kafka stores and distributes them, and how consumer groups share work, track offsets, and rewind to read subsequent messages.

Install and verify the Java JDK on your local machine, download the latest JDK from Oracle, and extract the package to set up your Apache Kafka development environment.

Download the latest release from zookeeper.apache.org, unzip, create a data directory, configure the zoo.cfg file, and start or stop ZooKeeper.

Learn to install and run a single-node Kafka server by downloading Kafka, starting ZooKeeper, launching Kafka with properties, and stopping the server.

Understand how ZooKeeper coordinates Kafka brokers and consumers as a distributed configuration and secret service, replicating critical data like topics and offsets to enable zero downtime.

Learn how to install and start zookeeper, verify it runs, connect with the zookeeper client, and stop it, laying groundwork for installing Apache Kafka.

Start Zookeeper, then start the Kafka server; create topics with replication factor 1 and a single partition, then list topics to verify setup for producing and consuming messages.

Learn how to modify an existing topic in Kafka by increasing partitions, adjusting replication, and deleting topics with ZooKeeper based commands, including the marker for deletion.

Set up and use the Kafka console producer and consumer to publish and consume messages on a single-node cluster, understanding brokers, topics, and ZooKeeper basics.

Configure multi-node Kafka by duplicating broker configurations, assigning unique broker IDs, and updating log directories to run multiple broker instances.

Set up and run a three-node Kafka cluster by configuring server properties, starting each node with its own config, and verifying ZooKeeper and broker are up.

Set up a multi-node Kafka topic with replication and partitions, inspect topic details with Kafka topics describe, and run a producer and consumer to publish and receive messages.

Explore the Kafka producer API to publish messages to topics, configure partitions, and use callbacks, flush, and producer records with keys and values.

Explore the Kafka consumer API, reading records from topics and partitions, and how consumer records are stored per partition in a Kafka cluster.