Apache Kafka Series - Learn Apache Kafka for Beginners
4.6 (925 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
4,217 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Apache Kafka Series - Learn Apache Kafka for Beginners to your Wishlist.

Add to Wishlist

Apache Kafka Series - Learn Apache Kafka for Beginners

Learn about Apache Kafka Ecosystem, Core Concepts, Operations, Kafka API, and Build Your Own Producers and Consumers
Best Seller
4.6 (925 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
4,217 students enrolled
Created by Stephane Maarek
Last updated 9/2017
Current price: $12 Original price: $20 Discount: 40% off
4 days left at this price!
30-Day Money-Back Guarantee
  • 4 hours on-demand video
  • 4 Articles
  • 6 Supplemental Resources
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion

Training 5 or more people?

Get your team access to Udemy's top 2,000 courses anytime, anywhere.

Try Udemy for Business
What Will I Learn?
  • Learn about Apache Kafka Ecosystem, Architecture, Core Concepts and Operations
  • Understand Fundamental Concepts behind Apache Kafka Like Topics, Partitions, Brokers, Producers, Consumers and Many More
  • Learn How to Install Docker on Your Machine and Start Your Personal Kafka Cluster for Development Purposes
  • Create and Configure Topics and Start Writing Data to and Reading Data from Topic
  • Integrate with popular programming frameworks, such as Spark, Spark Streaming, Akka Actors, Akka Stream, Scala and Apache NiFi
View Curriculum
  • A recent Windows / Mac / Linux machine with minimum 4GB of RAM, 5 GB of disk space
  • You must have some understanding of Java Programming
  • Good to have knowledge about Linux command line
  • A note book and pen is recommended to take notes during the entire course

Apache Kafka has become the leading data streaming enterprise technology. Kafka is used in production by over 2000 companies like Netflix, Airbnb, Uber and LinkedIn. To learn Kafka easily, step-by-step, you have come to the right place!

Take a look at these student reviews...

★★★★★  "That's one of the most high-quality on-line courses I ever took" – Paul Lysak

★★★★★   "This training was awesome and learnt many things about KAFKA though having 0 years of experience in this technology" – Puneet Gaur 

★★★★★  "Outstanding on all fronts! I wish all courses were that well presented. I especially appreciate the hands-on sections. I was able to get everything up and running with ease. Highly recommend this course and this instructor!" – David Goyette


Welcome to the Apache Kafka Series! Join 3000+ students and become a Kafka expert!

Apache Kafka for Beginners is the easiest way to start learning Kafka:

> Learn the Apache Kafka Ecosystem Architecture  
> Learn the Kafka Core Concepts: Topics, Partitions, Brokers, Replicas, Producers, Consumers 
> Launch your own Kafka cluster in no time using Docker – Windows / MacOS X / Linux 
> Learn and Practice using the Kafka Command Lines tools 
> Learn and Code Consumers and Producers using the Java API 
> Learn advanced Kafka topic configurations 
> Pointers for integration between Kafka and other frameworks (Spark, NiFi, Akka, Scala). 
> So much more!

Note: The hands-on section is based on Java, which is the native Kafka programming language. But, good news! Your learning in Java will be completely applicable to other programming languages, such as Python, C#, Node.js or Scala, and Big Data frameworks such as Spark, NiFi or Akka…


Stephane Maarek is the instructor of this course. He is a Kafka Expert, and the author of the highly-rated Apache Kafka Series on Udemy, having taught already to 5000+ students and received 1000+ reviews.

He shares all his Kafka knowledge on the platform, taking the time to explain every concept and provide students with both theoretical and practical dimensions. You are in good hands!

Section outline:

  • Apache Kafka and its ecosystem: In this section, we will learn about the Apache Kafka ecosystem, and see how some target architectures may look like. This high-level section helps you set context around Kafka!
  • Apache Kafka Core concepts: In this section, we will learn about all the fundamental concepts of Kafka like topics, partitions, replication, brokers, producers, consumers, consumer groups, Zookeeper, delivery semantics and more!
  • Docker and Kafka Setup: In this sections, we will learn how to install Docker on your machine and get started with Apache Kafka, in the simplest way possible.
  • Apache Kafka Hands-on Practice: In this section, we will gain some practical experience by learning how the various command lines tool work, as well as how to use Kafka Topics UI, and create your very first Producer and Consumer in Java...!!!
  • Code Examples - Libraries Integrations: In this section, we will learn about some more advanced code examples, and understand where to find the libraries to integrate with frameworks such as Spark, Spark Streaming, Akka Streams, Scala, Actors, Apache NiFi...
  • Advanced Topic Configuration: In this section, we will understand the main configurations for your topics, learn about Log Compaction, understand exactly what your partitions are made of!

This Course Also Comes With:

✔ Lifetime Access to All Future Updates

✔ A responsive instructor in the Q&A Section

✔ Links to interesting articles, and lots of good code to base your next applications onto

✔ Udemy Certificate of Completion Ready for Download

✔ A 30 Day "No Questions Asked" Money Back Guarantee!

This is the course that could change your life.  

Learning and getting hands-on on Apache Kafka helps you to enhance your career opportunities and helps to boost your income. An investment in your career is an investment in yourself.  Don’t procrastinate. There is no time like the present to take charge of your career. Take your career to the next level by learning Apache Kafka today!

Take the course now, completely risk free !

Note: Looking for more advanced Kafka concepts? Check-out the volumes of the Apache Kafka Series:

  • Learn Kafka for Beginners (this course)
  • Kafka Connect Hands On Learning
  • Kafka Streams for Data Processing
  • Kafka Cluster Setup & Administration
Who is the target audience?
  • This course has been prepared for beginners, who are aspiring to learn Apache Kafka fundamentals
  • This course is also ideal for professionals; those wanting to build a complete application using Apache Kafka
Compare to Other Apache Kafka Courses
Curriculum For This Course
46 Lectures
Introduction to Kafka and the ecosystem
6 Lectures 17:23

Description of the course objectives and a little bit about me!

Preview 01:15

Pre requisites to get the most out of this course

Pre-requisites before getting started

Let's try to understand what problems Apache Kafka is solving, and what Apache Kafka is used for

Preview 03:02

Overview of the Kafka Ecosystem and overview of the 4 parts of this series

Preview 08:06

Where does Kafka usually sit in a company's architecture?

Preview 01:18

Intro to Kafka and the ecosystem
4 questions

How to ask questions in the Q&A
Apache Kafka: Core Concepts
7 Lectures 28:37

Start Kafka and Zookeeper, create a topic, start writing to a topic, start reading from a topic. 


Kafka Guarantees, Message Ordering

Delivery Semantics: At least once, at most once, exactly once

Quiz about the Core Concepts you just learned about

Core concepts
13 questions
Apache Kafka: Install Docker and Start Kafka!
8 Lectures 31:22

Setting up Docker for Mac, for Mac that are updated to a recent enough version

Pre-requisite: Docker on Mac (recent versions)

Setting up Docker Toolbox on versions of Mac that are not compatible with the more recent Docker for Mac (see previous video)

Please note that the IP of your docker machine will be

Pre-requisite: Docker Toolbox on Mac (older versions)

Setting up Docker for Linux, as shown on Ubuntu

Pre-requisite: Docker on Linux (Ubuntu as an example)

Setting up Docker for Windows, for Windows 10 64bit versions

Pre-requisite: Docker on Windows 10 64bit

Setting up Docker Toolbox on versions of Windows that are not Windows 10 64bit. 

Please note that the IP of your docker machine will be

Pre-requisite: Docker Toolbox on Windows (other versions)

Important note for Docker Toolbox users

Finally! We're launching Kafka using Docker and checking if everything worked well

Starting Kafka!
Apache Kafka: Hands-on Practice
6 Lectures 56:06
Topic operations: create, list, delete, describe

Publishing data to a topic using the console producer

Consuming data from a topic using the console consumer

Kafka Topics UI

Writing your own producer

Writing your own consumer
Code Examples - Library Integrations
6 Lectures 58:08
Kafka Producer and Consumer Examples

Spark & Spark Streaming Kafka integration description

Spark & Spark Streaming Integration

Akka Streams Kafka integration description

Akka Streams Integration

Scala Cake Solutions library walkthrough

Scala Library & Actor Model Integration

Apache NiFi Integration

Pointers on how to use Kafka with the Spring Framework

Spring Framework (pointers)
Advanced: Topic Configuration
10 Lectures 49:18

Understand what are topic configurations and why they're important

Why should I care about Topic Configuration?

Hands on lecture to demonstrate how to set configurations at topic creation time, or how to alter topic configuration after it is created

Hands on: Changing Topic Configurations

Impact of Partitions Count and Replication Factor. Advice on how to set them

Partitions Count & Replication Factor

Description of the concept of segments and indexes

Segments and Indexes

Overview of the two cleanup policies that exist in Kafka

Log Cleanup Policy: Overview

Configuration of the delete log cleanup policy

Log Cleanup Policy: "delete" based on Time and Bytes

Theory lecture about Log Compaction

Log Cleanup Policy: Log Compaction - Theory

Hands on lecture that demonstrates how log compaction works

Hands On: Log Compaction

Learn about gz4, snappy and other compression mechanisms. Link to performance benchmarks

Log Compression

Learn about other advanced topic configurations

Other Advanced Topic Configurations
Next steps!
2 Lectures 04:10
What's next?

Congratulations and Thank you!
Bonus Lecture - Coupons For My Other Courses - Student Special Offer
1 Lecture 00:56
Bonus Lecture: Student Special Coupons for my Other courses
About the Instructor
Stephane Maarek
4.6 Average rating
1,563 Reviews
6,981 Students
6 Courses
Best Selling Instructor, Kafka Guru, AWS Solutions Architect

Stephane is a solutions architect, consultant and software developer that has a particular interest in all things related to big data and analytics. He's also a best seller instructor on Udemy for his courses in Apache Kafka, Apache NiFi and AWS Lambda!

He loves Apache Kafka. He regularly contributes to the Apache Kafka project and wrote a guest blog post featured on the Confluent website, the company behind Apache Kafka. 

He also is an AWS certified Solutions Architect, and has many years of experience with technologies such as Apache Kafka, Apache NiFi, Apache Spark, Hadoop, PostgreSQL, Tableau, Spotfire, Docker and Ansible amongst many others. 

His favourite programming languages are Scala and Python, and he plans on learning Go soon. 

During his spare time he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!