Apache Kafka Series - Kafka Monitoring & Operations
What you'll learn
- Setup a Multi Broker Kafka Cluster in no-time in AWS (using CloudFormation)
- Setup Administration Tools such as Kafka Manager, ZooNavigator, LinkedIn's Kafka Monitor
- Setup Monitoring using Grafana and Prometheus
- Learn how to perform a safe and automated Roll Restart of Kafka Brokers
- Update Brokers Configurations in a safe way
- Rebalance Partitions in a Kafka Cluster
- Increase and Decrease the Replication Factor of Topics
- Add a Broker to a Kafka Cluster
- Service and Replace a Broker in a Kafka Cluster
- Remove a Broker in a Kafka Cluster
- Install Command Line Interface (CLI) tools to automate workflows
- Upgrade a Kafka Cluster with no downtime
Requirements
- Kafka Basics + Setup Knowledge
- Linux Knowledge
- Windows / Linux / MacOS X are ok
- Cloud Computing Understanding preferred
- No Knowledge of AWS CloudFormation is required
Description
One of the best courses in the Apache Kafka Series!
Learn Kafka Administration, Kafka Monitoring, Kafka Operations and Kafka Upgrades in this 5+ hours course. Join hundreds of knowledge savvy students into learning some of the most important knowledges that any Kafka administrator should know and master.
----------------------------
This course is important for the following reasons:
Administration for Apache Kafka
> Setup UI tools such as Kafka Manager, ZooNavigator and Kafka Monitor to get a full view of your cluster
> Understand basic operations you can perform with these tools
Monitoring for Apache Kafka
> A Kafka that is not monitored is a ticking time-bomb.
> Setup proper monitoring for Kafka & Zookeeper
> Store your metrics in Prometheus and visualise in Grafana
Operations for Apache Kafka
> Perform the most common and difficult operations demanded in your Apache Kafka Cluster
> Roll Restart your brokers in only one command
> Update Kafka Configurations safely with no downtime
> Rebalance Partitions and Change the Replication Factor of your topics
> Add, Replace and Remove Brokers.
Upgrades for Apache Kafka
> Understand the subtlety of upgrading a Kafka Cluster
> Step by step explanation on upgrading a Cluster with no Downtime
----------------------------
PRE-REQUISITES - THIS IS AN ADVANCED COURSE
> Good Understanding of Kafka & Kafka Setup
> Basic Understanding of AWS Cloud.
> Knowledge of how to SSH into a Server
> Good Understanding of Linux & computing overall
> Strong Ability to use the Command Line
-----------------------------
Hands On Based Course
Note: This course is advanced and little time will be spent on basics. It will incur cost in AWS
This course is the first and only available Kafka Monitoring and Operations on the web. Get it now to become an Apache Kafka expert!
Section outline:
Course Introduction: Let's learn why we need Monitoring & Operations in Apache Kafka
Kafka Quick Setup in AWS: Setup Kafka using AWS CloudFormation. No Knowledge of CloudFormation is required
Kafka Administration Setup: Setup Basic Admin and Monitoring Tools on our Cluster
Kafka Monitoring Setup: Grafana + Prometheus: Setup Kafka & Zookeeper Monitoring using Prometheus and Grafana
Kafka Operations: Learn the most common and difficult Kafka operations
Kafka Cluster Upgrade: Learn the steps to properly upgrade a Kafka Cluster with no downtime
===============================
Instructor
My name is Stephane Maarek, and I'll be your instructor in this course. I teach about Apache Kafka, the Kafka ecosystem and Kafka Certifications with my focus always on helping my students improve their professional proficiencies. I am also the co-founder of Conduktor: an enterprise Apache Kafka platform & UI to help everyone use Kafka.
Throughout my career in designing and delivering these certifications and courses, I have already taught 1,000,000+ students and gotten 350,000+ reviews!
With Apache Kafka becoming much more than a buzzword out there, I've decided it's time for students to properly learn how to be a Kafka professional. So, let’s kick start the course! You are in good hands!
===============================
This Course Also Comes With:
Lifetime Access to All Future Updates
A responsive instructor in the Q&A Section
Links to interesting articles, and lots of good code to base your next applications onto
Udemy Certificate of Completion Ready for Download
This is the course that could improve your career!
Apache Kafka is a skill in high demand and there are not enough people to fulfill all the open positions. You can boost your income, take on new roles and fun challenges. Many of my students are now the Kafka experts of their companies! You can be the next!
I hope to see you inside the course!
=======================
Note: Looking for more advanced Kafka concepts? There are many volumes in the Apache Kafka Series:
Learn Kafka for Beginners v2 (great to start)
Kafka Connect Hands On Learning
Kafka Streams for Data Processing
KSQL on ksqlDB - Hands On!
Kafka Cluster Setup & Administration
Confluent Schema Registry & Kafka REST Proxy
Kafka Security (SSL SASL ACL)
Kafka Monitoring and Operations
Happy learning!
Who this course is for:
- Kafka Administrators who want to learn how to setup monitoring
- Kafka Administrators who want to learn how to perform Kafka operations
- Kafka Administrators who want to learn how to upgrade a Kafka cluster
Instructors
![Stephane Maarek | AWS Certified Cloud Practitioner,Solutions Architect,Developer](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
- 4.7 Instructor Rating
- 458,794 Reviews
- 1,499,905 Students
- 38 Courses
Stephane is a solutions architect, consultant and software developer that has a particular interest in all things related to Big Data, Cloud & API. He's also a many-times best seller instructor on Udemy for his courses in Apache Kafka and AWS.
[See FAQ below to see in which order you can take my courses]
Stéphane is recognized as an AWS Hero and is an AWS Certified Solutions Architect Professional & AWS Certified DevOps Professional. He loves to teach people how to use the AWS properly, to get them ready for their AWS certifications, and most importantly for the real world.
He also loves Apache Kafka. He sits on the 2019 Program Committee organizing the Kafka Summit in New York, London and San Francisco. He is also an active member of the Apache Kafka community, authoring blogs on Medium and a guest blog for Confluent.
During his spare time he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!
FAQ: In which order should you learn?...
AWS Cloud: Start with AWS Certified Solutions Architect Associate, then move on to AWS Certified Developer Associate and then AWS Certified SysOps Administrator. Afterwards you can either do AWS Certified Solutions Architect Professional or AWS Certified DevOps Professional, or a specialty certification of your choosing. Once ready, you can learn AWS Lambda and AWS CloudFormation in depth, or do the AWS Big Data certification.
Apache Kafka: Start with Apache Kafka for Beginners, then you can learn Connect, Streams and Schema Registry if you're a developer, and Setup and Monitoring courses if you're an admin. Both tracks are needed to pass the Confluent Kafka certification.
gRPC: First do the protocol buffers course, then move on to gRPC Java or gRPC Golang course.
In order to share knowledge I am not able to respond to private messages on Udemy. If you're a student, please ask questions inside the course. Thanks for understanding!
- 4.6 Instructor Rating
- 52,374 Reviews
- 186,231 Students
- 10 Courses
Conduktor is an Apache Kafka enterprise platform that helps your team be more efficient and faster at using Apache Kafka.
Conduktor Desktop is our first product: an Apache Kafka desktop client that allows developers use Apache Kafka with confidence. The Apache Kafka UI is adapted for all Kafka clusters and has features for the entire Apache Kafka ecosystem, including Confluent, Kafka Connect and Kafka Streams!
The Conduktor Platform is in early preview, please contact us for more information.
Conduktor was founded by Stéphane Maarek, the best-selling instructor on Apache Kafka here on Udemy.