Apache Kafka Series - Learn Apache Kafka for Beginners v2
4.7 (15,196 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
67,038 students enrolled

Apache Kafka Series - Learn Apache Kafka for Beginners v2

START HERE: Learn Apache Kafka 2.0 Ecosystem, Core Concepts, Real World Java Producers/Consumers & Big Data Architecture
Bestseller
4.7 (15,196 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
67,038 students enrolled
Last updated 5/2020
English
English, French [Auto-generated], 7 more
  • German [Auto-generated]
  • Indonesian [Auto-generated]
  • Italian [Auto-generated]
  • Polish [Auto-generated]
  • Portuguese [Auto-generated]
  • Romanian [Auto-generated]
  • Spanish [Auto-generated]
Current price: $104.99 Original price: $149.99 Discount: 30% off
5 hours left at this price!
30-Day Money-Back Guarantee
This course includes
  • 7.5 hours on-demand video
  • 18 articles
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  • Understand Apache Kafka Ecosystem, Architecture, Core Concepts and Operations
  • Master Concepts such as Topics, Partitions, Brokers, Producers, Consumers
  • Start a personal Kafka development environment
  • Learn major CLIs: kafka-topics, kafka-console-producer, kafka-console-consumer, kafka-consumer-groups, kafka-configs
  • Create your Producers and Consumers in Java to interact with Kafka
  • Program a Real World Twitter Producer & ElasticSearch Consumer
  • Extended APIs Overview (Kafka Connect, Kafka Streams), Case Studies and Big Data Architecture
  • Practice and Understand Log Compaction
Course content
Expand all 123 lectures 07:37:33
+ Kafka Theory
11 lectures 37:40
Kafka Theory Overview
00:29
Brokers and Topics
03:19
Topic Replication
04:12
Producers and Message Keys
05:25
Consumers & Consumer Groups
04:37
Consumer Offsets & Delivery Semantics
04:39
Kafka Broker Discovery
02:23
Zookeeper
02:42
Kafka Guarantees
01:09
Theory Roundup
01:58
Quiz on Theory
13 questions
+ Starting Kafka
12 lectures 37:37
Important: Starting Kafka
00:23
FAQ for Setup Problems
00:44
Mac OS X - Download and Setup Kafka in PATH
04:44
Mac OS X - Using brew
01:29
Mac OS X - Start Zookeeper and Kafka
05:37
Mac OS X - Summary
00:17
Linux - Download and Setup Kafka in PATH
05:34
Linux - Start Zookeeper and Kafka
04:56
Linux - Summary
00:19
Windows - Download Kafka and PATH Setup
08:13
Windows - Start Zookeeper & Kafka
04:59
Windows - Summary
00:21
+ CLI (Command Line Interface) 101
11 lectures 34:22
CLI Introduction
00:23
WINDOWS WARNING: PLEASE READ
00:19
Kafka Topics CLI
07:32
Kafka Console Producer CLI
07:08
Kafka Console Consumer CLI
03:21
Kafka Consumers in Group
06:29
Kafka Consumer Groups CLI
04:13
Resetting Offsets
04:07
CLI Options that are good to know
00:10
What about UIs? Conduktor
00:31
KafkaCat as a replacement for Kafka CLI
00:09
Quiz on CLI
7 questions
+ Kafka Java Programming 101
12 lectures 01:06:40
Intro to Kafka Programming
00:25
Installing Java 8 & IntelliJ Community Edition
00:09
Creating Kafka Project
06:24
Java Producer
10:49
Java Producer Callbacks
06:52
Java Producer with Keys
06:08
Java Consumer
11:49
Java Consumer inside Consumer Group
06:29
Java Consumer with Threads
11:50
Java Consumer Seek and Assign
04:22
Client Bi-Directional Compatibility
01:17
Configuring Producers and Consumers
00:06
Quiz on Java Programming 101
9 questions
+ ===== Kafka Real World Project =====
2 lectures 01:01
Real World Project Overview
00:45
Real World Exercise
00:16
+ Kafka Twitter Producer & Advanced Configurations
15 lectures 01:05:23
Producer and Advanced Configurations Overview
00:28
Twitter Setup
04:44
Producer Part 1 - Writing Twitter Client
10:13
Producer Part 2 - Writing the Kafka Producer
07:46
Producer Configurations Introduction
00:48
acks & min.insync.replicas
06:15
retries, delivery.timeout.ms & max.in.flight.requests.per.connection
04:45
Idempotent Producer
04:29
Producer Part 3 - Safe Producer
05:15
Producer Compression
04:44
Producer Batching
04:51
Producer Part 4 - High Throughput Producer
03:07
Producer Default Partitions and Key Hashing
02:24
[Advanced] max.block.ms and buffer.memory
02:30
Quiz on Producer Configurations
6 questions
Refactoring the Project
03:04
+ Kafka ElasticSearch Consumer & Advanced Configurations
14 lectures 59:11
Consumer and Advanced Configuration Overview
00:27
Setting up ElasticSearch in the Cloud
03:13
ElasticSearch 101
05:47
Consumer Part 1 - Setup Project
08:22
Consumer Part 2 - Write the Consumer & Send to ElasticSearch
06:21
Delivery Semantics for Consumers
04:11
Consumer Part 3 - Idempotence
07:45
Consumer Poll Behaviour
02:58
Consumer Offset Commit Strategies
02:44
Consumer Part 4 - Manual Commit of Offsets
04:39
Consumer Part 5 - Performance Improvement using Batching
05:39
Consumer Offsets Reset Behaviour
02:06
Consumer Part 6 - Replaying Data
01:58
Consumer Internal Threads
03:01
Quiz on Consumer Configurations
6 questions
Requirements
  • A recent Windows / Mac / Linux machine with minimum 4GB of RAM, 5 GB of disk space
  • Some understanding of Java Programming
  • Good to have knowledge about Linux command line
  • Desire to learn something awesome and new!
Description

UPDATE SEPTEMBER 2018: Course newly recorded with Kafka 2.0!

Welcome to the Apache Kafka Series! Join a community of 20,000+ students learning Kafka.

Apache Kafka has become the leading distributed data streaming enterprise  big data technology. Kafka is used in production by over 33% of the Fortune 500 companies such as Netflix, Airbnb, Uber, Walmart and LinkedIn.

To learn Kafka easily, step-by-step, you have come to the right place! No prior Kafka knowledge is required

===============================

If you look at the documentation, you can see that Apache Kafka is not easy to learn...

Thanks to my several years of experience in Kafka and Big Data, I wanted to make learning Kafka accessible to everyone.

We'll take a step-by-step approach to learn all the fundamentals of Apache Kafka.
At the end of this course, you'll be productive and you'll know the following:

  • The Apache Kafka Ecosystem Architecture

  • The Kafka Core Concepts: Topics, Partitions, Brokers, Replicas, Producers, Consumers, and more!

  • Launch your own Kafka cluster in no time using native Kafka binaries – Windows / MacOS X / Linux 

  • Learn and Practice using the Kafka Command Line Interface (CLI)

  • Code Producer and Consumers using the Java API 

  • Real world project using Twitter as a source of data for a producer and ElasticSearch as a sink for our consumer

  • Overview of Advanced APIs (Kafka Connect, Kafka Streams)

  • Real World Case Studies and Big  Use cases

  • Overview of Advanced Kafka for Administrators

  • Advanced Topic Configurations

  • Annexes (starting a Kafka cluster locally, using Docker, etc...)

Note: The hands-on section is based on Java, which is the native Kafka programming language. But, good news! Your learning in Java will be completely applicable to other programming languages, such as Python, C#, Node.js or Scala, and Big Data frameworks such as Spark, NiFi or Akka

===============================

The Kafka for Beginners course is the best place to start your Kafka learning journey... Ask other students!

  • ★★★★★  "That's one of the most high-quality on-line courses I ever took" – Paul L.

  • ★★★★★  "This training was awesome and learnt many things about KAFKA though having 0 years of experience in this technology" – Puneet G.

  • ★★★★★  "Outstanding on all fronts! I wish all courses were that well presented. I especially appreciate the hands-on sections. I was able to get everything up and running with ease. Highly recommend this course and this instructor!" – David G.   

You can take this course risk-free and if you don't like it, you can get a refund anytime in the first 30 days!

===============================

Instructor

Stephane Maarek is the instructor of this course. He is a Kafka Expert, guest author on the Confluent Blog and Speaker at the Kafka Summit SF 2018. He's the author of the highly-rated Apache Kafka Series on Udemy, having taught already to 40,000+ students and received 12,000+ reviews.

He shares all his Kafka knowledge on the platform, taking the time to explain every concept and provide students with both theoretical and practical dimensions. You are in good hands!

===============================

This Course Also Comes With:

✔ Lifetime Access to All Future Updates

✔ A responsive instructor in the Q&A Section

✔ Links to interesting articles, and lots of good code to base your next applications onto

✔ Udemy Certificate of Completion Ready for Download   


This is the course that could improve your career!  

Apache Kafka is a skill in high demand and there are not enough people to fulfil all the open positions. You can boost your income, take on new roles and fun challenges. Many of my students are now the Kafka experts of their companies!

I hope to see you inside the course!

=======================

Note: Looking for more advanced Kafka concepts? There are many volumes in the Apache Kafka Series:

  • Learn Kafka for Beginners v2 (this course - great to start)

  • Kafka Connect Hands On Learning

  • Kafka Streams for Data Processing

  • Kafka Cluster Setup & Administration

  • Confluent Schema Registry & Kafka REST Proxy

  • Kafka Security (SSL SASL ACL)

  • Kafka Monitoring and Operations

Happy learning!

Who this course is for:
  • Developers who want to learn the Apache Kafka Fundamentals, start a cluster and write their first application
  • Architects who want to understand how Apache Kafka fits into their solution architecture
  • Anyone looking to learn the full theory of how Apache Kafka works as a distributed system