Amazon MSK Crash Course
What you'll learn
- AWS Managed Streaming Kafka (MSK)
- MSK Kafka Connect
- Glue Schema Registry
- Deployment Recipies using CDK
- Spring Kafka Java Clients
- Python Kafka Clients
- MSK Authentication with IAM
- MSK Authentication with SASL/SCRAM
- Debezium CDC from Aurora PostgreSQL via MSK Connect
- MSK Storage Autoscaling
- MSK Broker Expansion
Requirements
- General AWS Knowledge (VPCs, IAM, Autoscaling, EC2, SSM, Secrets Manager)
- Python Programming
- Java Programming (optional, only needed for Java examples)
- Apache Kafka Fundamentals
Description
AWS Managed Streaming Apache Kafka (MSK) Crash Course is where students learn the essential concepts and operational characteristics of this wildly popular AWS service. The Amazon MSK Crash Course is designed specifically for mid to senior level engineers and architects who are already proficient with general AWS Cloud concepts (things like IAM, VPCs, SSM Parameter Store, Secrets Manager, EC2, Application Autoscaling, and Lambda) as well as Apache Kafka fundamentals (things like Brokers, Topics, Partitions, Scalability and Reliability, Kafka Connect, Message Schemas). The course goal is to equip developers and architects with the knowledge needed to confidently implement MSK into existing projects or dive in as a productive and trusted contributor to existing projects utilizing AWS MSK.
Information in this course is presented in a manner that balances enough theory to understand the capabilities of the technologies covered immediately followed by practical hands on demos of the theoretical content. The hands on demos heavily rely on easy to understand Apache Kafka client code samples and high quality Infrastructure as Code (IaC) based deployment recipes based on AWS Cloud Development Kit (CDK). This approach gives students the fundamental knowledge and confidence to dive deeper into the examples and further tweak or extend them to fit a variety of use cases.
Who this course is for:
- Cloud Engineers and Architects looking to quickly become productive with Amazon MSK
Instructor
Experienced Software Engineer with a demonstrated history of working in High-Tech Enterprises like Digital Media, Biotech, and Financial Services. Skilled at crafting well engineered solutions (responsive, scalable, fault tolerant with sensible observability) across multiple technology frameworks and languages spanning all layers of the enterprise. Server-side development experience includes Python, NodeJS/Typescript, and Java paired with client technologies like JavaFX, ElectronJS, VueJS and ReactJS. Early career exposure to the challenges of high volume high complexity data in the sciences provided a strong foundation in analytics and data engineering spanning simple automation to distributed computing technologies like Celery, Redis, Spark, Hive, Kafka, Kinesis and, deep understanding of relational databases (PostgreSQL especially).