Beginners Guide to Apache Kafka with SpringBoot

Compare Kafka and RabbitMQ, showing Kafka's real-time streaming with replayable history and consumer replay, versus queue-based routing with publish-subscribe and message guarantees.

Understand how a stream of messages becomes a topic and how producers publish payload bytes to topics. Watch brokers store messages in a cluster as consumers subscribe to topics.

Explore how Kafka brokers are the stateless heart of the cluster, handling topics where producers publish and consumers subscribe, with Zookeeper managing broker changes and SLA-based retention enabling rereading.

ZooKeeper coordinates Kafka brokers, signaling broker health and notifying producers and consumers about new or failed brokers. A topic is divided into partitions spread across brokers to balance load.

Understand how Apache Kafka stores messages on the broker filesystem: partitions map to logical logs, implemented as segment files that flush to disk after configured thresholds, exposing data to consumers.

Install kafka on your computer by navigating to the kafka download page, clicking download, and starting the download before continuing to the next video.

Extract the Kafka bundle, inspect the Windows and Linux bin scripts, and launch Zookeeper first before starting Kafka to manage brokers in the cluster.

Create a data folder in the kafka root with zookeeper and kafka subfolders for zookeeper data and kafka logs, and update the zookeeper properties to point to the data directory.

Update the zookeeper and log files paths by editing the configuration, copying the Kafka data folder, and saving changes in the properties file to enable starting zookeeper.

Discover how to start Zookeeper first and then the Kafka server, using Zookeeper as a discovery service for cluster awareness, and troubleshoot common startup issues on Windows.

Create a topic named quickstart events, publish a message with a producer, and consume it with a consumer, while listing topics and troubleshooting ZooKeeper and Kafka commands.

Learn to create real-time producers and consumers in Apache Kafka with Spring Boot, exchange messages via topics, and run multiple producers and consumers communicating without lag.

Set up your local development environment by installing the Java development kit, a code editor, and Postman for API testing, then configure environment variables, Maven, Git, and MySQL.

Create producer and consumer Spring Boot apps from Spring Initializr, include web and Spring for Apache Kafka, and publish or listen to messages on a Kafka cluster.

Configure a Spring Boot Kafka producer by setting application properties for the bootstrap server and the topic name, then create the producer class and prepare for implementation.

Create a Golf Club Producer using Spring Boot and KafkaTemplate to send messages to a topic, with the topic name from properties, and expose a rest controller to publish messages.

Configure the consumer by copying producer settings into the consumer properties, add a consumer group id, and point to the same Kafka cluster and topic.

Register a Kafka consumer with Spring Boot using a listen method to receive string messages from a topic, then publish via a producer and verify end-to-end messaging.

Publish json data to a Kafka topic using a Spring Boot publisher endpoint, then consume the messages with a consumer, demonstrating Postman requests and end-to-end messaging.