Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS AWS Certified Developer - Associate CompTIA Security+
Photoshop Graphic Design Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Mindfulness Personal Development Personal Transformation Meditation Life Purpose Coaching Neuroscience
Web Development JavaScript React CSS Angular PHP Node.Js WordPress Python
Google Flutter Android Development iOS Development Swift React Native Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Retargeting
SQL Microsoft Power BI Tableau Business Analysis Business Intelligence MySQL Data Analysis Data Modeling Big Data
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Online Business Business Plan Startup Freelancing Blogging Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ 2D Game Development Unreal Engine Blueprints Blender
30-Day Money-Back Guarantee

This course includes:

  • 5 hours on-demand video
  • 13 articles
  • Full lifetime access
  • Access on mobile and TV
IT & Software Other IT & Software Apache Kafka

Apache Kafka Series - Kafka Monitoring & Operations

Kafka Monitoring Setup with Prometheus and Grafana, Kafka Operations and Kafka Cluster Upgrades Hands-On. Setup in AWS
Highest Rated
Rating: 4.7 out of 54.7 (628 ratings)
8,412 students
Created by Stephane Maarek | AWS Certified Solutions Architect & Developer Associate
Last updated 1/2021
English
30-Day Money-Back Guarantee

What you'll learn

  • Setup a Multi Broker Kafka Cluster in no-time in AWS (using CloudFormation)
  • Setup Administration Tools such as Kafka Manager, ZooNavigator, LinkedIn's Kafka Monitor
  • Setup Monitoring using Grafana and Prometheus
  • Learn how to perform a safe and automated Roll Restart of Kafka Brokers
  • Update Brokers Configurations in a safe way
  • Rebalance Partitions in a Kafka Cluster
  • Increase and Decrease the Replication Factor of Topics
  • Add a Broker to a Kafka Cluster
  • Service and Replace a Broker in a Kafka Cluster
  • Remove a Broker in a Kafka Cluster
  • Install Command Line Interface (CLI) tools to automate workflows
  • Upgrade a Kafka Cluster with no downtime
Curated for the Udemy for Business collection

Requirements

  • Kafka Basics + Setup Knowledge
  • Linux Knowledge
  • Windows / Linux / MacOS X are ok
  • Cloud Computing Understanding preferred
  • No Knowledge of AWS CloudFormation is required

Description

One of the best courses in the Apache Kafka Series!

Learn Kafka Administration, Kafka Monitoring, Kafka Operations and Kafka Upgrades in this 5+ hours course. Join hundreds of knowledge savvy students into learning some of the most important knowledges that any Kafka administrator should know and master.

----------------------------

This course is important for the following reasons:

Administration for Apache Kafka

> Setup UI tools such as Kafka Manager, ZooNavigator and Kafka Monitor to get a full view of your cluster
> Understand basic operations you can perform with these tools

Monitoring for Apache Kafka

> A Kafka that is not monitored is a ticking time-bomb.
> Setup proper monitoring for Kafka & Zookeeper
> Store your metrics in Prometheus and visualise in Grafana

Operations for Apache Kafka

> Perform the most common and difficult operations demanded in your Apache Kafka Cluster
> Roll Restart your brokers in only one command
> Update Kafka Configurations safely with no downtime
> Rebalance Partitions and Change the Replication Factor of your topics
> Add, Replace and Remove Brokers.

Upgrades for Apache Kafka

> Understand the subtlety of upgrading a Kafka Cluster
> Step by step explanation on upgrading a Cluster with no Downtime

----------------------------

PRE-REQUISITES - THIS IS AN ADVANCED COURSE

> Good Understanding of Kafka & Kafka Setup
> Basic Understanding of AWS Cloud.
> Knowledge of how to SSH into a Server
> Good Understanding of Linux & computing overall
> Strong Ability to use the Command Line

-----------------------------

Instructors

Stephane Maarek is the instructor of this course. He is an Apache Kafka Expert, and the author of the highly-rated Apache Kafka Series on Udemy, having taught already to 40000+ students and received 12000+ reviews.  He shares all his Apache Kafka knowledge on the platform, taking the time to explain every concept and provide students with both theoretical and practical dimensions.

Hands On Based Course

Note: This course is advanced and little time will be spent on basics. It will incur cost in AWS

This course is the first and only available Kafka Monitoring and Operations on the web. Get it now to become an Apache Kafka expert!

Section outline:

  1. Course Introduction: Let's learn why we need Monitoring & Operations in Apache Kafka

  2. Kafka Quick Setup in AWS: Setup Kafka using AWS CloudFormation. No Knowledge of CloudFormation is required

  3. Kafka Administration Setup: Setup Basic Admin and Monitoring Tools on our Cluster

  4. Kafka Monitoring Setup: Grafana + Prometheus: Setup Kafka & Zookeeper Monitoring using Prometheus and Grafana

  5. Kafka Operations: Learn the most common and difficult Kafka operations 

  6. Kafka Cluster Upgrade: Learn the steps to properly upgrade a Kafka Cluster with no downtime

This Course Also Comes With:

✔ Lifetime Access to All Apache Kafka course Future Updates

✔ A responsive instructor in the Q&A Section

✔ Links to interesting articles, and lots of good code to base your next applications onto

✔ Udemy Certificate of Completion Ready for Download

✔ A 30 Day "No Questions Asked" Money Back Guarantee!

Learn Kafka Monitoring & Operations Now!

Kafka Monitoring and Operations are crucial knowledge for any Kafka Administrator. Get all the necessary knowledge with this Apache Kafka Series course! The job market will definitely need people like you

"Take This Course" risk free and learn the Kafka Monitoring & Operations now!

Who this course is for:

  • Kafka Administrators who want to learn how to setup monitoring
  • Kafka Administrators who want to learn how to perform Kafka operations
  • Kafka Administrators who want to learn how to upgrade a Kafka cluster

Course content

8 sections • 64 lectures • 5h 8m total length

  • Preview07:09
  • Important Message
    01:52

  • Code Download
    00:14

  • What is AWS CloudFormation
    01:32
  • Target Architecture and Setup
    04:18
  • Create AWS Account & Cost of Tutorial
    00:22
  • [Hands-On] Deploy Zookeeper Using CloudFormation
    08:15
  • [Hands-On] Deploy Kafka Using CloudFormation
    07:38
  • [Hands-On] Overview of our Zookeeper Cluster
    09:26
  • [Hands-On] Overview of our Kafka Cluster
    05:03
  • [Hands-On] Stopping the Kafka Cluster
    02:49

  • [Hands-On] Overview and Setup of Monitoring Machine
    08:10
  • IMPORTANT: Security
    00:25
  • [Hands-On] Setup Zoonavigator
    07:52
  • [Hands-On] Setup Kafka Manager
    08:08
  • [Hands-On] Setup Kafka Monitor
    09:27
  • Commands Cheat Sheet
    00:10

  • Overview of Monitoring
    05:06
  • [Hands-On] Setting up Prometheus + Kafka Broker 1
    Preview17:31
  • [Exercise] Broker 2 & 3 Prometheus Setup
    00:17
  • [Solution] Broker 2 & 3 Prometheus Setup
    05:20
  • [Exercise] Zookeeper & Prometheus Setup
    00:18
  • [Solution] Zookeeper & Prometheus Setup
    09:40
  • [Hands-On] Setup Grafana on Administration Server
    06:49
  • [Hands-On] Setup Kafka Dashboard on Grafana
    05:43
  • Preview06:04
  • [Hands-On] Adding Graphs to Grafana
    10:15
  • [Exercise] Adding more graphs to Grafana
    00:08
  • [Solution] Adding more graphs to Grafana
    03:01
  • Find Grafana dashboard in the code
    00:03
  • What about monitoring Kafka Connect, Kafka Streams, etc?
    00:26
  • [Hands-On] Observing Grafana when we kill a broker
    05:05
  • Considerations to make the setup production-ready
    01:59

  • [Hands-On] Install Jolokia Agent on Broker 1
    07:54
  • [Exercise] Install Jolokia on Broker 2 & 3
    00:09
  • [Solution] Install Jolokia on Broker 2 & 3
    03:38
  • [Hands-On] Install Rolling Restart Script
    14:03
  • [Hands-On] Run Roll Restart Script
    07:21
  • [Hands-On] Updating Configurations 1st method (rolling restart)
    03:45
  • [Hands-On] Updating Configurations 2nd method (kafka-configs command)
    11:18
  • [Hands-On] Rebalancing Partitions using plain commands and JSON
    12:10
  • [Hands-On] Rebalancing Partitions using Kafka Manager
    02:40
  • [Hands-On] Rebalancing Partitions using LinkedIn tools
    08:10
  • [Hands-On] Increasing Replication Factor using plain commands and JSON
    06:38
  • [Hands-On] Increasing Replication Factor using LinkedIn tools
    04:47
  • [Hands-On] Adding Broker 4 using CloudFormation
    09:55
  • [Exercise] Moving partitions over to Broker 4 using the CLI tools
    00:08
  • [Solution] Moving partitions over to Broker 4 using the CLI tools
    04:30
  • [Hands-On] Replacing a Broker keeping EBS Volume
    07:02
  • [Hands-On] Replacing a Broker losing an EBS Volume
    03:41
  • Removing a Broker Overview
    01:00
  • [Exercise] Remove Broker 4
    00:10
  • [Solution] Remove Broker 4
    08:01

  • Upgrading a Kafka Cluster Overview
    02:19
  • [Advanced] Zero Copy, Up and Down Conversions
    08:06
  • [Hands-On] Kafka Broker Upgrade Step 1
    04:02
  • [Hands-On] Kafka Broker Upgrade Step 2
    02:58
  • [Hands-On] Kafka Broker Upgrade Step 3
    03:03
  • [Hands-On] Kafka Broker Upgrade Step 4
    01:40
  • [Hands-On] Kafka Broker Upgrade Step 5
    03:14

  • Cleaning up AWS
    01:17
  • Next Steps & Congratulations!
    02:02
  • THANK YOU!
    01:32
  • Bonus Lecture: Student Special Coupons for my Other courses
    01:00

Instructor

Stephane Maarek | AWS Certified Solutions Architect & Developer Associate
Best Selling Instructor, Kafka Guru, 9x AWS Certified
Stephane Maarek | AWS Certified Solutions Architect & Developer Associate
  • 4.7 Instructor Rating
  • 205,855 Reviews
  • 680,324 Students
  • 38 Courses

Stephane is a solutions architect, consultant and software developer that has a particular interest in all things related to Big Data, Cloud & API. He's also a many-times best seller instructor on Udemy for his courses in Apache Kafka and AWS.

[See FAQ below to see in which order you can take my courses]

Stéphane is recognized as an AWS Hero and is an AWS Certified Solutions Architect Professional & AWS Certified DevOps Professional. He loves to teach people how to use the AWS properly, to get them ready for their AWS certifications, and most importantly for the real world.

He also loves Apache Kafka. He sits on the 2019 Program Committee organizing the Kafka Summit in New York, London and San Francisco. He is also an active member of the Apache Kafka community, authoring blogs on Medium and a guest blog for Confluent.  

During his spare time he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!

FAQ: In which order should you learn?...

AWS Cloud: Start with AWS Certified Solutions Architect Associate, then move on to AWS Certified Developer Associate and then AWS Certified SysOps Administrator. Afterwards you can either do AWS Certified Solutions Architect Professional or AWS Certified DevOps Professional, or a specialty certification of your choosing. Once ready, you can learn AWS Lambda and AWS CloudFormation in depth, or do the AWS Big Data certification.

Apache Kafka: Start with Apache Kafka for Beginners, then you can learn Connect, Streams and Schema Registry if you're a developer, and Setup and Monitoring courses if you're an admin. Both tracks are needed to pass the Confluent Kafka certification.

gRPC: First do the protocol buffers course, then move on to gRPC Java or gRPC Golang course.


In order to share knowledge I am not able to respond to private messages on Udemy. If you're a student, please ask questions inside the course. Thanks for understanding!

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.