Apache Kafka Concepts - For the Absolute Beginner

Name: Apache Kafka Concepts - For the Absolute Beginner
Rating: 4.5 (34 reviews)

Learn Apache Kafka - Architecture, Core Concepts, Key Components, Kafka CLI, Kafka API, Java Producers and Consumers

Created byInterview Grid

Last updated 4/2021

English

English [Auto],

What you'll learn

Understand the basics of Apache Kafka - Architecture and Core Concepts
Learn Core Components of Kafka - Clusters, Brokers, Topics, Partitions, Messages, Offsets, Producers, Consumers, Consumer Groups
Setup and Start Kafka Development Environment in Local Machine
Learn Common CLI - kafka-topics, kafka-console-producer, kafka-console-consumer, kafka-consumer-groups, kafka-configs
Develop Producer and Consumer Programs in Java
Setup multi-broker Kafka cluster and review broker failure scenarios

Course content

7 sections • 35 lectures • 2h 48m total length

Welcome!3:02
Course Objectives2:03
Explore Kafka basics, architecture, core concepts and components; set up a local Kafka cluster, use the command line to manage ZooKeeper, brokers, topics, producers and consumers, and program with Java.

Kafka Core Concepts - Introduction0:50
Overview of Apache Kafka12:30
Explore traditional architectures' limitations and how Kafka, a distributed streaming platform, enables loose coupling, high throughput, and real-time use cases like messaging and log aggregation.
Quiz - Overview of Apache Kafka
Core Components of Kafka2:53
Topics, Partitions, And Messages2:59
Kafka Clusters and Replication6:24
Explore how Kafka clusters with multiple brokers create topics across brokers and distribute partitions via round-robin; use replication with a replication factor and partition leaders or in-sync replicas for durability.
Core Components of Kafka - Topics, Partitions, Messages, Brokers, Clusters
Kafka Producers3:13
Kafka Consumers and Consumer Groups6:29
Zookeeper1:35
Kafka Producers, Consumers, Zookeeper
Kafka Core Concepts - Summary1:23

Kafka CLI - Introduction0:52
Kafka Console - Start Zookeeper8:44
Start a Zookeeper server from console in your local machine
Kafka Console - Start Broker7:40
Start a Kafka server from console in your local machine
Kafka Console - Create Topic8:42
Create a Kafka topic from console in your local machine
Kafka Console - Producer CLI4:06
Create a Kafka producer from console in your local machine, and post messages to a Kafka topic
Kafka Console - Consumer CLI4:56
Create a Kafka consumer from console in your local machine, and consume messages from a Kafka topic
Kafka Console - Consumer Group CLI0:09
Kafka CLI - Summary0:11

Introduction to Kafka Programming API1:58
Install Java 8 and IntelliJ IDE0:15
Create Kafka Project15:39
Develop Java Producer16:15
Develop Java Producer with Callback12:23
Develop a Java producer with a callback to access partition and offset metadata after sending, and learn how default partitioning and message keys influence partition selection.
Java Producer - Configurations2:32
Explore Java producer configurations in Kafka by examining default values, properties like bootstrap servers localhost:1992, client id, key/value serializers, and default partition handling, with hands-on reflection on the producer program.
Develop Java Consumer16:18
Kafka Programming - Summary0:41

Requirements

Windows, Mac, or Linux Machine with a minimum of 5 GB of disk space and 4 Gb of RAM
Basic Understanding of Java Programming Language
Basic knowledge of Linux command line - If using Linux Machine
Basic knowledge of Windows command line - If using Windows machine

Description

Apache Kafka is a distributed streaming platform used by thousands of companies for numerous batch as well as real-time data integration and data streaming use cases.

Kafka is used by thousands of companies across the world, and its popularity and usage is increasing exponentially.

As a result, the demand for people (developers, architects, devops engineers, product managers, project managers, etc.) with knowledge of Kafka is increasing every day.

You can build, and grow up, in your career by learning this awesome technology.

In this beginner level course you will learn the basics of kafka, setup Kafka in your local machine, use Kafka commands to create and interact with Kafka components, program Kafka in Java using Kafka API, and will setup Kafka cluster and review server failure scenarios.

By the end of this course you will be able to work with kafka in real-world environments. Plus this course will also help you ace your Kafka interviews!

In this course -

You will learn about the architecture of Kafka, core concepts of Kafka, and the key components of Kafka.
You will learn about Kafka clusters, Kafka brokers, Kafka topics, Kafka partitions, Kafka messages, Kafka producers, Kafka consumers, and Kafka consumer groups.
You will setup Kafka in your local environment, and use Kafka CLI to create and interact with the key components of Kafka.
You will install IntelliJ Java IDE, and will program Kafka producers and Kafka consumers using Java programming language.
You will create a multi-broker Kafka cluster in your local environment
You will look into broker failure scenarios.
By the end of this course - you will be able to work with Kafka in real-world environments and use-cases.

Thank You! And hope to see you in the course.

Who this course is for:

Developers who wants to learn the BASICS of Kafka - to program applications using Kafka API
Architects who want to learn the BASICS of Kafka - to understand it's role in Enterprise Architectures
Devops who want to learn the BASICS of Kafka - to understand the role and setup of Kafka components

Apache Kafka Concepts - For the Absolute Beginner

What you'll learn

Explore related topics

Course content

Introduction2 lectures • 5min

Kafka Core Concepts9 lectures • 38min

Setup Kafka5 lectures • 10min

Kafka CLI (Command Line Interface)8 lectures • 35min

Programming Kafka - In Java8 lectures • 1hr 6min

Multi-Broker Kafka Cluster2 lectures • 14min

Thank You1 lecture • 1min

Requirements

Description

Who this course is for: