Apache Kafka for Beginners - Learn Kafka by Hands-On
4.3 (147 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
857 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Apache Kafka for Beginners - Learn Kafka by Hands-On to your Wishlist.

Add to Wishlist

Apache Kafka for Beginners - Learn Kafka by Hands-On

Kafka - Deep dive in to Apache Kafka concepts and develop a working app using Docker, Java, Camel,Spark,Spring Boot.
4.3 (147 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
857 students enrolled
Last updated 7/2017
English
Curiosity Sale
Current price: $10 Original price: $20 Discount: 50% off
30-Day Money-Back Guarantee
Includes:
  • 6 hours on-demand video
  • 1 Article
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
What Will I Learn?
  • Understand all the Kafka concepts and Kafka core internals.
  • Create Topics, Post data in to topic and Read from Topic using different technologies.
  • Build a complete working app with Kafka producer and consumer using Java, Apache Camel, Spring Boot and Docker.
  • Learn to develop Kafka Clients using Apache Spark
  • Learn to code Kafka Producer and Consumers using Apache Camel.
  • Learn to run Dockerized Kafka Broker, Zookeeper and Dockerized Spring Boot App
  • Implementation of Kafka security using SSL in Java.
  • Download , Install and Usage of Kafka Client GUI Tool.
  • By the end of the course you will have a complete understanding of Apache Kafka and hands on experience on how to implement these principles.
View Curriculum
Requirements
  • Basic commands in Unix/Windows Platform.
  • Basic Java Knowledge.
  • Basics of Windows/Mac Platform
Description

Description:

Learn the fundamentals and advanced concepts of Apache Kafka in this course. There will be a hands on for each concept using inbuilt shell scripts that are available inside the Kafka download and using Java, Camel,Spark Spring Boot and Docker.

  • This course will walk you through the concepts step by step and immediate hands on for each topic discussed.
  • This course will help increase your technical expertise in Kafka which will make you an much needed candidate in IT.
  • This course will be an eyeopener for people think Kafka is a complex system, eventually you will understand how simple Kafka is.
  • This course can be a career breakthrough and assure you that you will find yourself in a better place after you complete this course.
  • This course will transfer your from novice Kafka user to a experienced Kafka user.

Why I should take this course ?

  • This course will walk you through the Kafka architecture, different components of the Kafka architecture and advantages  of Kafka over other systems.
  • This course will focus on the internals of the Kafka and how to use Kafka and implement the concepts that are learnt in real time.
  • This course will teach you how to implement the concepts using Java, Camel, Spark, Spring Boot and Docker.

Course Overview:

Section 1: Getting Started

  • This section explains about the author and the course objectives.

Section 2: Kafka Architecture

  • This section explains about the following:
    • Why do you need Kafka ?
    • What is Kafka ?
    • Kafka Architecture and the different components in the Kafka architecture.
      • Role of zookeeper, Kafka Broker, Kafka Cluster, Producers and Consumers.

Section 3: Download Kafka

  • This sections explored about the different approaches of downloading the Kafka distribution in your local.

Section 4: Core Internals of Apache Kafka + Hands on

  • This section shows you the demo on  how to start zookeeper and Kafka broker.
  • Detailed explanation about Topics, Partitions, Consumers and Producers.
  • Hands on creating topic  and how to connect producer and consumers to the created topic using Console Producer and Consumer.
  • Hands  on about  Kafka commit log.

Section 5 : Kafka API's

  • This section explains about the different Core API's and its use cases.

Section 6 : Behind the scenes zookeeper, Broker , Producer and Consumers

  • This section explains about what are the different Kafka components that interact with each to create a topic using a flow diagram
  • This sections also covers how producers and consumers connect to the Kafka and what are the different components that interact with each other behind the scenes.

Section 7 : Running Multiple Brokers

  • Hands on how to run multiple brokers in your machine.
  • How does the consumer and producer while running it against the multiple brokers.
  • Hands on Leader, Replica and ISR attributes in a Topic.

Section 8 : Kafka Producers

  • Detailed explanation about Kafka Producer and how to connect to the Kafka Cluster.
  • How to implement the Kafka producer using Java?
  • Exploring different partitioning mechanism and implementation in Java.
  • How to alter the configuration of a topic?

Section 9 : Kafka Consumer

  • Detailed explanation about Kafka Consumer.
  • How to implement the Kafka Consumer using Java?
  • Different types of Offset Management in Kafka Consumer.
    • Automatic Offset Management using Java.
    • Manual Offset Management using Java.
  • Consumer Groups in Kafka consumer and its Advantages.
  • Consumer Group id and its benefits.
  • Implementation of consumer group in Java.
  • How to reset the offset to a particular value in Kafka Consumer ?

Section 10: Kafka Client - GUI Tool

  • In this section we will download, install and demo about the Kafka GUI client tool that will be used to connect and Manage the Kafka cluster.

Section 11: Apache Camel + Kafka Integrationa

  • Quick Introduction to Apache Camel
  • Apache Camel simple example
  • Apache Camel Architecture
  • Hands on - How to Build a Kafka consumer using Apache Camel Framework ?
  • Hands on - How to Build a Kafka producer using Apache Camel Framework ?

Section 12: Apache Spark + Kafka Integrationa

  • Quick Introduction to Apache Spark
  • Hands on - How to Build a Kafka consumer using Apache Spark Framework ?

Section 12: Additional Configurations

How to delete a topic ?

Section 13: Apache Kafka -Spring Boot Implementation

This section explains about the Spring boot Implementation of Apache Kafka modules

  • Quick Introduction to Spring
  • Quick Introduction to Spring boot
  • Simple Spring Boot App via hands on
  • Kafka Consumer using Spring Boot
  • Kafka Producer using Spring Boot

Section 14: Docker - Dockerize Kafka Broker, Zookeeper, Producer and Consumer

In this section we will run the dockerized version of kafka broker, zookeeper and we will create the docker image of the Spring boot App.

  • Quick Introduction to Docker.
  • Installation of Docker Tool Box on Windows 10.
  • Installation of Docker Tool Box on Mac.
  • Creating a docker image of the spring boot App
  • Creating an Account in Docker Hub and push/pull from Docker Hub.
  • Exploring Different Docker commands.
  • How to run Kafka Broker/Zookeeper in Docker ?
  • Complete Integration and working app of Dockerized Kafka Broker, Zookeeper and dockerized Spring boot app.


Section 15: Apache Kafka Security and Authentication

In this section we will explore about the Kafka security 

  • Why do you need Kafka security ?
  • Hands on session on how to enable SSL in Kafka Broker ?
  • Hands on session on how to access the SSL secured broker using Console Consumer/Producer?
  • Hands on session on how to configure SSL in Kafka Producer using Java ?
  • Hands on Session on how to configure SSL in Kafka Consumer using Java ?
  • How to delete a topic ?

Section 16: Conclusion

  • Congratulations and Thank You !

By the end of this you will have a complete understanding of how Apache Kafka works and how to implement the concepts in real time using Java, Apache Camel, Apache Spark , Spring Boot and Docker.


Who is the target audience?
  • Any one who is willing to learn about Kafka.
Students Who Viewed This Course Also Viewed
Curriculum For This Course
60 Lectures
06:13:14
+
Getting Started
2 Lectures 01:49
+
Kafka Architecture
3 Lectures 09:21

What is Kafka?
01:35

This lecture explains about Kafka Architecture, Distributed Systems and Role of Zookeeper.

Kafka Architecture
04:17
+
Download Kafka
2 Lectures 04:48

Download and Install Kafka using curl command
01:08
+
Core Internals of Apache Kafka + Kafka Concepts Hands On
4 Lectures 24:41

This tutorial will show you a demo on How to start Zookeeper and Kafka Broker?

Hands on - How to start Zookeeper and Kafka Broker ?
03:17

This tutorial explains about Topic, Partitions, Multi Partitions, Retention Period in Topic.

Kafka Topics, Partitions,Producers,Consumers and Retention Period in Topic
08:23

This hands on session explains about how to create a topic, how to publish the message using console producer, how to consume the message using console consumer and Kafka logs folder.

Hands on - Create Topic, Producer and Consume Messages, Kafka Log Folder
11:00

+
Kafka API's
1 Lecture 02:10

In this tutorial, we will discuss about Kafka core Apis and their uses.

Kafka Core API's
02:10
+
Behind the Scenes - Zookeeper, Broker, Producers and Consumers
2 Lectures 03:30

This tutorial explains about what happens behind the scenes when a create topic command is issued.

Behind the Scenes - Create topic, Zookeeper and Broker
01:46

This tutorial explains about what happens when how the consumers and producers interact to the Kafka.

Behind the scenes - Producers and Consumers
01:44
+
Running Multiple Kafka Brokers
2 Lectures 19:53

This tutorial explains about how to run multiple Kafka brokers in your machine, how to create multiple partitions in a topic and how does the consumer behaves for multiple partitions in a topic.

Hands On - Running Multiple Kafka Brokers
10:16

Hands on - Replication Factor, Leader and ISR
09:37
+
Kafka Producers
4 Lectures 25:46
Download and Install Eclipse
02:36

In this tutorial, we will have hands on  how to code the Kafka producer in Java. I will walk you through the code line by line.

Hands on - Kafka Producer coding using Java
12:24

Hands on - How to alter the configuration of a topic ?
02:07

In this tutorial, we will have hands on  about different partitioning approaches in the producer end,

Hands on - Producer Partitioning Mechanism using Java
08:39
+
Kafka Consumers
7 Lectures 48:26

This tutorial is going to show you a demo of Kafka consumer using Java and walk you through the code line by line.

Hands on - Kafka Consumer using Java
12:33

In this tutorial, we will discuss about the differences between manual and automatic offset management. I will show you a demo on default offset management by Kafka and override the default management by manually committing the offset in the consumer end.

Hands On - Offset Management in Kafka consumer using Java
08:07

Consumer Group in Kafka Consumer - Insight and Benefits
03:18

This tutorial show you the demo on  the benefits of consumer groups using Java. How does the zookeeper rebalances if the consumer goes down ?  

Hands on - Consumer Group using Java
11:40

In this tutorial, I will show you hands on about group id and its impacts in the Kafka Consumer.

Hands on - Group Id and its Impacts
02:51

In this tutorial, I will show you a demo on how to reset the offset to a specific value and re read the messages from it.

Hands on - Reset to a specific Offset value in Kafka Consumer using Java
08:12

Kafka Consumer - Additional Configurations
01:45
+
Kafka Client - GUI Tool
1 Lecture 09:36

In this tutorial I will show you demo on how to download, install and use the Kafka client tool.

Kafka - GUI Client
09:36
8 More Sections
About the Instructor
Dilip Bandla Sundarraj
4.3 Average rating
154 Reviews
927 Students
2 Courses
Best Selling Instructor, Senior Software Engineer

My name is Dilip Bandla Sundarraj, I am a software developer and a tech savvy with 9+ years of experience. I love to code and have a great passion towards learning new technologies. I always had the passion to teach my colleagues and friends on whatever new cool stuff I come across in my life. I love interacting with other software developers and learn from them.

During my leisure time I love to play cricket, watch movies and working out in the gym to achieve balance between physical and mental strength.

-- Dilip B Sundarraj.