
This lecture provides an overview of the course and the course objectives.
This video describes the prerequisites in order to be able to setup your own development
This lecture explains how kafka works, how it will help you and some use cases of Kafka
In this video we talk about the kafka core and we will explain the kafka extended API, the confluent components schema registry and REST proxy and finally we list the administration and monitoring tools
Here we talk about the apache Kafka architecture for batch and real time processing, and we will an overview about the highly available multi-datacenter streaming, using confluent to manage your transition to the cloud or back and the automatic data balancing
this video contains a short review of topics from the "Introduction to Apache Kafka" lecture
This lecture explain the first important components of Apache Kafka, we will describe the topics and partitions by using examples
This lecture explains another important component of Apache Kafka, we will describe the brokers, data replication and the concept of leader by using examples. finally, we will talk about “how to create a kafka Topis” by giving command lines
This lecture represents the working method of producers, we describe how producers write data to topics, we will talk about the acknowledgment of data writes and finally the message keys of the producer.
This lecture represents the principle of consumers and consumer groups and finally we will describe data availability of consumers
This video represents the advantage of Consumer offsets and how consumer can be able to read back the data due to consumer offsets, finally we will talk about the method that consumers choose when to commit offsets
in this video we will talk about Kafka broker discovery and the concept of bootstrap servers
in this video we will talk about Kafka broker discovery and the concept of bootstrap servers
This lecture represents the Kafka guarantees
this video shows you a diagram which sums up all what you learned until now
this video contains a short review of topics from the "Apache Kafka core concepts" lecture
This lecture explains how to download and install Kafka on centos 7.
this video is following the previous video, it will explain how to start Kafka service on centos 7.
This lecture explains how to download, install and start Kafka on windows 10.
This video discusses about the CLI introduction
this lecture explain how to create a topic on CLI and also some other important commands
this video explain how to manipulate producer on CLI, we will the most important command about producers
this lecture explain how to read messages sent by producers and other options about consumers
this video shows how to use kafka consumer groups command to manipulate our consumer groups
his lectures represents the important of consumers groups and how to use them
this video shows how to use kafka consumer groups command to manipulate our consumer groups
In this video we will learn how to reset offsets for the topics.
this lecture explain an important UI tool of apache Kafka it’s called kafka tool, it’s like the command line but with UI.
Introduction to kalfka Java Programming
this video represents how to create a new project in IntelliJ IDE and do a “Hello world”.
This video represents a hands-on to create a producer in java and check the message send to the consumer.
this video explain the callbacks for producer in java
this video explains how to order messages by using keys for producers
this video explain how to use consumers with java
this lecture represents the rebalancing feature of consumer groups with java
this video presents the seek and assign in a java class
this lecture represents the client Bi-Directional Compatibility
This video describes about the Realworld project overview
this represents an overview of producer and advanced configurations
this video represents how to create an application in twitter developer account
this video it's the first part of the creation of the twitter producer
this lecture represents an introduction of producer configurations
In this lecture we will talk about acks and min.insync.replicas properties
In this lecture we will talk about some important properties like retries and max.in.flight.requests.per.connection
In this lecture we explain how to produce and have a high throughput by using idempotent property
This lecture represents how to have a safe producer with an example
in this video we will explain producer compression
This lecture talk about producer batching
This lecture is a hands-on example to have a high throughput producer
This lecture explains the Producer Default Partitions and Key Hashing
This is an advanced lecture that explains the meaning of and how to use max.block.ms and buffer.memory
In this lecture, we will refactor to basically isolate the dependencies of Kafka basics and Kafka producer Twitter, into separate files that can be independently taken.
Consumer and advanced configuration overview
In this lecture we will how to setup a cluster elasticsearch in the cloud
In this, we will explain the most basic to know how elasticsearch works.
In this we will do a hands-on example to consume some example data and get this data in the elasticsearch cluster
In this lecture we will continue the previous example but this time we will consume twitter data with our cluster.
In this lecture we will talk about delivery semantics in depth
Apache Kafka has become the leading distributed data streaming enterprise big data technology. Kafka is used in production by over 33% of the Fortune 500 companies such as Netflix, Airbnb, Uber, Walmart, and LinkedIn.
To learn Kafka easily, step-by-step, you have come to the right place! No prior Kafka knowledge is required.
If you look at the documentation, you can see that Apache Kafka is not easy to learn...
Thanks to my several years of experience in Kafka and Big Data, I wanted to make learning Kafka accessible to everyone.
We'll take a step-by-step approach to learn all the fundamentals of Apache Kafka.
At the end of this course, you'll be productive and you'll know the following:
The Apache Kafka Ecosystem Architecture
The Kafka Core Concepts: Topics, Partitions, Brokers, Replicas, Producers, Consumers, and more!
Launch your own Kafka cluster in no time using native Kafka binaries – Windows / MacOS X / Linux
Learn and Practice using the Kafka Command Line Interface (CLI)
Code Producer and Consumers using the Java API
Real-world project using Twitter as a source of data for a producer and ElasticSearch as a sink for our consumer
Note: The hands-on section is based on Java, which is the native Kafka programming language. But, good news! Your learning in Java will be completely applicable to other programming languages, such as Python, C#, Node.js or Scala, and Big Data frameworks such as Spark, NiFi or Akka.