Apache Kafka Series - Kafka Cluster Setup & Administration
What you'll learn
- Setup a Zookeeper and Kafka cluster on three machines in AWS
- Learn how to deploy Kafka in Production and understand the target architecture for clusters in AWS
- Setup ZooKeeper Cluster, learn its role for Kafka and usage
- Setup Kafka in Cluster Mode with 3 brokers, including configuration, usage and maintenance
- Shutdown and Recover Kafka brokers, to overcome the common Kafka broker problems
- Configure Kafka Cluster with production settings and optimisations for better performances based on your workload
- Setup web administration tools using Docker: ZooNavigator, Kafka Manager, Confluent Schema Registry, Confluent REST Proxy, Landoop Kafka Topics UI
- Administer Kafka using Kafka Manager
Requirements
- Strong knowledge on Computers, Servers and Networking
- Strong knowledge of Linux commands, we will use Ubuntu 16.04
- Good knowledge of AWS, we will use it as our cloud provider
- Good knowledge of Apache Kafka
- An AWS account and a budget to setup the required machines for the course
Description
Attention all struggling System Administrators, Architects or even Developers! Here is course on how to set up and deploy Apache Kafka in Cluster mode.
Do you want to learn how to setup a Kafka Cluster on multiple servers and stop struggling with it?
Do you want to understand all the steps to perform a Kafka setup and Kafka Deployment in Production?
Have you been trying endlessly to deploy a Kafka Cluster, but haven't had any luck?
If you have answered YES, then you are at the right place.
Learn from Stephane Maarek, the Best-Selling Instructor on Udemy in Apache Kafka and Big Data!
This course is designed for System Administrators, Architects and Developers. It includes a step by step guide for installing a ZooKeeper Quorum and a Kafka Cluster. Hands-on training on Kafka Administration is also provided.
This course has Amazon Web Services for our cloud environment, which is used by many companies around the world. AWS Knowledge is a pre-requisite.
In this course, we will cover what ZooKeeper is, its architecture, its role in Apache Kafka, and the setup, installation and configuration on multiple machines!
This course reveals exactly how your Kafka Cluster on multiple machines should be setup and configured. We will start with understanding the Kafka basics, cluster size and the configuration. We will also have a hands-on learning on AWS Setup, Single Broker Setup, Multi Broker Setup, Testing the Cluster, Kafka Manager (Cluster Management), Demonstrating Kafka Resiliency etc. We will enlighten you on Kafka Performance with respect to I/Os, Network, RAM, CPU, OS (Operating System) etc. You will have hands on learning on how to run Kafka in Production on AWS, how to change a Kafka Broker Configuration and we will also cover the Advanced Kafka Configurations.
Why I should take this course?
- With over 4 hours of videos and around 50 classes, you will get a great understanding of how to deploy Kafka in production and you will understand the target architecture for clusters in AWS
- You will learn what ZooKeeper? is, it’s role for Kafka, How to setup ZooKeeper? and its usage
- You will have a complete understanding Kafka setup including setup, configuration, usage and maintenance etc.
- You will have a Kafka broker shutdown and recovery demonstration, which will help you to understand how to overcome the Kafka broker problems
- You will learn Kafka production settings and how to optimise settings for better performance
- You will learn all the required tool setups such as ZooNavigator, Kafka Manager, Confluent Schema Registry, Confluent REST Proxy, Landoop Kafka Topics UI.
- You will get hands-on learning on Kafka common Administrative tasks using Kafka Manager
- You have life-time access to this course and a 30-day satisfaction guaranteed with this course
Overview of the Course Contents -
Section 1 – Course Introduction: In this section, we will have introduction to the course. We will talk about what are the course pre-requisites, course objectives, who are the targeted students for this course. You will also have course material for download in this section!
Section 2 - Target Architecture: In this section, we will see the cloud providers such as AWS and explore other alternatives for AWS. We will also cover ZooKeeper Quorum Architecture and Kafka Cluster Architecture in this section.
Section 3 - Zookeeper Quorum Setup: In this sections, we will learn what is ZooKeeper, the Zookeeper role in Kafka Cluster, and ZooKeeper Configuration. We will have hands-on labs on AWS Setup, Zookeeper Single Machine Setup and Zookeeper Quorum Setup.
Section 4 - Kafka Cluster Setup: In this section, we will gain some practical hands-on experience on further AWS Setup, Single Kafka Broker Setup, Multi Kafka Broker Setup etc. Before that we will see Apache Kafka Basics on Kafka Configurations. We will have a demonstration on how to change the Kafka Broker configuration and we will also cover advanced Kafka configurations in this section.
After taking this course, you will become proficient in deploying Kafka in production! You will know all the required setups and installations and Kafka production settings and will be able to set-up Kafka in cluster mode in your own environment!
So, what are you waiting for? Go ahead and click the “Enrol Now” button.
You have 30 days’ money back guarantee and a lifetime access to the course! See you soon!
Who this course is for:
- System Administrators or Architects, who would like to learn or setup a Kafka Cluster on multiple servers
- Developers who want to understand the inner depth of a Kafka setup
- This course is designed for expert students and should not be taken until all the pre-requisites are met
Featured review
![M V BHARADWAJ MANEM](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
Course content
- Preview04:46
- Preview03:24
- 00:38Cost of the tutorial
- 00:37Important Message
Instructor
- 4.7 Instructor Rating
- 225,232 Reviews
- 729,963 Students
- 38 Courses
Stephane is a solutions architect, consultant and software developer that has a particular interest in all things related to Big Data, Cloud & API. He's also a many-times best seller instructor on Udemy for his courses in Apache Kafka and AWS.
[See FAQ below to see in which order you can take my courses]
Stéphane is recognized as an AWS Hero and is an AWS Certified Solutions Architect Professional & AWS Certified DevOps Professional. He loves to teach people how to use the AWS properly, to get them ready for their AWS certifications, and most importantly for the real world.
He also loves Apache Kafka. He sits on the 2019 Program Committee organizing the Kafka Summit in New York, London and San Francisco. He is also an active member of the Apache Kafka community, authoring blogs on Medium and a guest blog for Confluent.
During his spare time he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!
FAQ: In which order should you learn?...
AWS Cloud: Start with AWS Certified Solutions Architect Associate, then move on to AWS Certified Developer Associate and then AWS Certified SysOps Administrator. Afterwards you can either do AWS Certified Solutions Architect Professional or AWS Certified DevOps Professional, or a specialty certification of your choosing. Once ready, you can learn AWS Lambda and AWS CloudFormation in depth, or do the AWS Big Data certification.
Apache Kafka: Start with Apache Kafka for Beginners, then you can learn Connect, Streams and Schema Registry if you're a developer, and Setup and Monitoring courses if you're an admin. Both tracks are needed to pass the Confluent Kafka certification.
gRPC: First do the protocol buffers course, then move on to gRPC Java or gRPC Golang course.
In order to share knowledge I am not able to respond to private messages on Udemy. If you're a student, please ask questions inside the course. Thanks for understanding!