
Set up a spring boot kafka application with web and kafka dependencies, producer, consumer, controller classes, and a properties file; start zookeeper and kafka, then test rest api with Postman.
Download and set up Kafka by visiting the downloads page, selecting the latest stable Scala 2.12 binary, unzipping the file, and locating the ZooKeeper shell scripts in the bin folder.
learn to create a kafka listener in eclipse by using @service and @kafkaListener, wiring a topic and group id, printing received messages, and refactoring class names.
Create a Kafka controller in Eclipse, wiring @RestController, @RequestMapping, and @GetMapping to send a message to a topic via myKafkaProducer, illustrating the controller producer consumer flow.
Commands needed for execution:
Command to start the zookeeper:
.\bin\windows\zookeeper-server-start.bat .\config\zookeeper.properties
Command to start the kafka server:
.\bin\windows\kafka-server-start.bat .\config\server.properties
This course is an upskilling opportunity for anyone who want to learn Apache Kafka and apply it in real time. If you are a beginner and new to Kafka, this course will be very useful to you. It is a detailed course and covers the fundamentals of Kafka.
Apache Kafka is an open source, distributed, event streaming platform. It combines messaging, storage, and stream processing, to allow storage and analysis, of both historical and real time data. It's biggest advantage is: it allows multiple independent applications, reading from data streams, to work independently, at their own rate. Hence, making the overall processing fast and scalable.
You all must be aware that Kafka is being used widely now-a-days, and have multiple job opportunities. This course is going to be very helpful for anyone seeking opportunities in the same. Throughout this course, you will learn how a message flows from a message queue and subscribers listen to those messages from the topics.
Pros:
Scalability and High performance
Multiple producers and consumers
High availability and fault tolerance
Security and Flexibility
Multi-language environment
Kafka Connect for simple integration
Easy to understand documentation, guides, and learning resources
In this series, we will discuss following topics in a detail :
How Kafka Works?
Project Setup
Download Kafka
Create Project
Listener
Producer
Controller
Project Execution