Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS CompTIA Security+ Microsoft AZ-900
Photoshop Graphic Design Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Mindfulness Personal Development Personal Transformation Life Purpose Meditation Coaching Neuroscience
Web Development JavaScript React CSS Angular PHP WordPress Node.Js Python
Google Flutter Android Development iOS Development Swift React Native Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Retargeting
SQL Microsoft Power BI Tableau Business Analysis Business Intelligence MySQL Data Analysis Data Modeling Data Science
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Online Business Business Plan Startup Freelancing Blogging Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ Unreal Engine Blueprints 2D Game Development Blender
30-Day Money-Back Guarantee

This course includes:

  • 4.5 hours on-demand video
  • 7 articles
  • Full lifetime access
  • Access on mobile and TV
Development Development Tools Apache Kafka

Apache Kafka Series - Confluent Schema Registry & REST Proxy

Kafka - Master Avro, the Confluent Schema Registry and Kafka REST Proxy. Build Avro Producers/Consumers, Evolve Schemas
Rating: 4.7 out of 54.7 (1,798 ratings)
12,538 students
Created by Stephane Maarek | AWS Certified Solutions Architect & Developer Associate
Last updated 1/2021
English
30-Day Money-Back Guarantee

What you'll learn

  • Write simple and complex Avro Schemas
  • Create, Write and Read Avro objects in Java
  • Write a Java Producer and Consumer leveraging Avro data and the Schema Registry
  • Learn about Schema Evolution
  • Perform Schema evolution using the command line and in Java
  • Utilize the REST Proxy using a REST Client
Curated for the Udemy for Business collection

Course content

9 sections • 58 lectures • 4h 30m total length

  • Preview04:10
  • Course Structure & Objectives
    05:57
  • About your instructor
    02:20
  • Preview02:26

  • Code Download for the Class
    00:14

  • What is Avro?
    Preview08:19
  • Avro Primitive Types
    02:16
  • Avro Record Schema Definition
    06:41
  • Avro Complex Types
    05:46
  • Practice Exercise: Customer & CustomerAddress
    04:51
  • Avro Logical Types
    02:46
  • The complex case of Decimals
    04:01
  • Example of Avro Schemas on the Web
    00:08
  • Avro Schemas Quiz
    7 questions
  • Avro Section Summary
    00:37

  • Section Objective
    01:16
  • Generic Record in Avro - Hands On
    20:10
  • Specific Record in Avro - Hands On
    13:33
  • Check-in on now vs later in Kafka
    01:43
  • Avro Tools - Hands On
    04:15
  • Reflection in Avro - Hands On
    04:44
  • Schema Evolution - Theory
    07:42
  • Schema Evolution - Hands On
    07:33
  • Avro in Java Quiz
    10 questions
  • Avro Java Section Summary
    01:51

  • Important information about Kafka setup
    01:03
  • Docker on Mac (recent versions)
    03:54
  • Docker Toolbox on Mac (older versions)
    05:16
  • Docker on Linux (ubuntu as an example)
    04:56
  • Docker on Windows 10 64bit
    03:42
  • Docker Toolbox on Windows (older versions)
    05:37
  • Increasing RAM for Docker - PLEASE READ
    01:01
  • Frequently Asked Questions - Common Issues
    02:26
  • Starting Kafka using Docker Compose
    04:36

  • Confluent Schema Registry
    07:44
  • Kafka Avro Console Producer & Consumer
    09:29
  • Writing a Kafka Avro Producer in Java
    Preview12:58
  • Writing a Kafka Avro Consumer in Java
    07:40
  • Reminder on Schema Evolution
    01:04
  • Writing a V2 Kafka Producer
    06:58
  • Writing a V2 Kafka Consumer
    03:45
  • Summary on Compatibility Changes
    01:15
  • Kafka Schema Registry Deep Dive
    04:31
  • Managing Schemas Efficiently & Section Summary
    02:13
  • Confluent Schema Registry and Kafka Quiz
    7 questions

  • Kafka REST Proxy Introduction and Purpose
    03:54
  • V1 vs V2 APIs
    02:18
  • Insomnia Setup (REST Client)
    01:26
  • Topic Operations
    03:26
  • Producing in Binary with the Kafka REST Proxy
    07:15
  • Consuming in Binary with the Kafka REST Proxy
    05:07
  • Producing in JSON with the Kafka REST Proxy
    03:18
  • Consuming in JSON with the Kafka REST Proxy
    03:25
  • Producing in Avro with the Kafka REST Proxy
    05:36
  • Consuming in Avro with the Kafka REST Proxy
    03:42
  • Confluent REST Proxy Quiz
    7 questions

  • What are Annexes?
    00:13
  • Full Avro End to End: Kafka Producer + Kafka Connect + Kafka Streams
    19:00
  • Kafka REST Proxy Installation and Scaling - Overview
    03:39

  • What's next?
    01:43
  • THANK YOU!
    01:32
  • Bonus Lecture: Special Coupons to my Other Courses
    01:00

Requirements

  • Good knowledge of Apache Kafka
  • Some Java knowledge
  • A recent computer (Windows / Linux / Mac OS X) with 4GB of RAM
  • Understand JSON data format
  • Knowledge of REST APIs is better

Description

The new volume in the Apache Kafka Series!

Learn Apache Avro, the Confluent Schema Registry for Apache Kafka and the Confluent REST Proxy for Apache Kafka. Join hundreds of knowledge savvy students into learning some of the most important components in a typical Apache Kafka stack.

Take a look at these student reviews...

★★★★★  "Excellent course. A must for Apache Kafka users." – Mayank

★★★★★  "Beautiful explanation of Avro and how to use it with Apache Kafka. This knowledge enhancing like all your other courses. We have Apache Kafka from Confluent in our enterprise and this is what I was exactly looking for. Thanks a lot." – Vinod

★★★★★   "Stephane Maarek is truly remarkable instructor! His instructional videos do not disappoint, they keep me wanting more and provide exactly the Kafka skills needed to be successful." – Troy

----------------------------

Apache Avro is one of the most powerful and most popular fast data serialisation mechanism with Apache Kafka

> Schema is a first class citizen of the data
> Data serialisation format that is lightweight
> Documentation is embedded in the schema
> Easy to read and write using many languages
> Fast & Big data de-facto data serialisation format


Confluent Schema Registry for Apache Kafka is the de-facto standard way of storing Avro Schemas for your Apache Kafka Topics.

> Stores a versioned history of all your schemas in Apache Kafka
> Supports and enforces conditions for schema evolution (backward, forward, full compatibility)
> Kafka Avro Serialiser and Deserialiser automatically integrate with Apache Kafka and Confluent Schema Registry
> Make your messages much smaller and lighter! Perfect for increasing Apache Kafka throughput and performance

Confluent REST Proxy is the perfect way to communicate for sending Avro data using non Java languages to Apache Kafka. 

> Write and Read binary, JSON and Avro data to Apache Kafka using an HTTP REST API
> Interact with Apache Kafka using any programming language (not just Java)
> Consult topic list and topic metadata in Apache Kafka

Instructor

Stephane Maarek is the instructor of this course. He is an Apache Kafka Expert, and the author of the highly-rated Apache Kafka Series on Udemy, having taught already to 40000+ students and received 12000+ reviews.   He shares all his Apache Kafka knowledge on the platform, taking the time to explain every concept and provide students with both theoretical and practical dimensions. You are in good hands!

Hands On & Theory Based Course

Note: This course is comprehensive, and the Apache Kafka related bits do not start before the Kafka Schema Registry section. This is to ensure Avro Schema and Avro in Java is fully understood before moving to the Confluent Schema Registry for Apache Kafka. 

This course is the first and only available Kafka Schema Registry and Kafka REST Proxy course on the web. Get it now to become an Apache Kafka expert!

Section outline:

  1. Course Introduction: Let's learn why we need Schema, and what the target Kafka architecture will look like. 

  2. Avro Schemas: Master how to write simple and complex Avro Schemas for your Kafka messages, as well as Schema Evolution rules and guidelines. 

  3. Avro in Java: Learn how to create Avro records using GenericRecord, SpecificRecord, and ReflectedRecord. Also perform your first schema evolution in Java. 

  4. Setup and Launch Kafka: Install Docker and use Docker Compose to start your Apache Kafka Cluster that will contain the Confluent Schema Registry and the Kafka REST Proxy.

  5. Confluent Schema Registry and Kafka: Learn what is the Confluent Schema Registry, how it works. Learn to use the Kafka Avro Console Producer & Consumer, and write your first Apache Kafka Avro Java Producer and Avro Java Consumer. Perform a fully compatible schema evolution

  6. Confluent REST Proxy: Learn how to use the REST Proxy with a REST Client (Insomnia) in order to interface with Apache Kafka using REST. Understand how to read Kafka topic metadata, produce and consume binary, JSON and Avro data

  7. Annexes: Extra Apache Kafka lectures to push your learning further

This Course Also Comes With:

✔ Lifetime Access to All Apache Kafka course Future Updates

✔ A responsive instructor in the Q&A Section

✔ Links to interesting articles, and lots of good code to base your next applications onto

✔ Udemy Certificate of Completion Ready for Download

✔ A 30 Day "No Questions Asked" Money Back Guarantee!

Learn The Confluent Components Now!

Apache Kafka is increasingly becoming a must-have skill, and this course will set you up for fast success using Avro in Kafka, and the Confluent Components - the Kafka Schema Registry and the Kafka REST Proxy. The job market will need people with your newly acquired skillset!

"Take This Course" risk free and learn the Confluent Schema Registry and Kafka REST Proxy now!

Who this course is for:

  • Developers who would like to learn how to write and run an application that leverages Avro and the Schema Registry
  • Architects who want to understand the role of the Schema Registry and REST Proxy in an enterprise pipeline
  • This course is intended for people who fully understand the basics of Kafka
  • People who want to learn the Confluent Components: Schema Registry and REST Proxy

Featured review

Vladimir Bystrov
Vladimir Bystrov
88 courses
19 reviews
Rating: 5.0 out of 59 months ago
I have enjoyed this course. The contents is very good, and I love the how Stephane is teaches the topic. Also it has good hand-ons. So I recommend this course to anyone who wants to learn about Avro and Confluent Schema Registry.

Instructor

Stephane Maarek | AWS Certified Solutions Architect & Developer Associate
Best Selling Instructor, Kafka Guru, 9x AWS Certified
Stephane Maarek | AWS Certified Solutions Architect & Developer Associate
  • 4.7 Instructor Rating
  • 208,683 Reviews
  • 688,274 Students
  • 38 Courses

Stephane is a solutions architect, consultant and software developer that has a particular interest in all things related to Big Data, Cloud & API. He's also a many-times best seller instructor on Udemy for his courses in Apache Kafka and AWS.

[See FAQ below to see in which order you can take my courses]

Stéphane is recognized as an AWS Hero and is an AWS Certified Solutions Architect Professional & AWS Certified DevOps Professional. He loves to teach people how to use the AWS properly, to get them ready for their AWS certifications, and most importantly for the real world.

He also loves Apache Kafka. He sits on the 2019 Program Committee organizing the Kafka Summit in New York, London and San Francisco. He is also an active member of the Apache Kafka community, authoring blogs on Medium and a guest blog for Confluent.  

During his spare time he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!

FAQ: In which order should you learn?...

AWS Cloud: Start with AWS Certified Solutions Architect Associate, then move on to AWS Certified Developer Associate and then AWS Certified SysOps Administrator. Afterwards you can either do AWS Certified Solutions Architect Professional or AWS Certified DevOps Professional, or a specialty certification of your choosing. Once ready, you can learn AWS Lambda and AWS CloudFormation in depth, or do the AWS Big Data certification.

Apache Kafka: Start with Apache Kafka for Beginners, then you can learn Connect, Streams and Schema Registry if you're a developer, and Setup and Monitoring courses if you're an admin. Both tracks are needed to pass the Confluent Kafka certification.

gRPC: First do the protocol buffers course, then move on to gRPC Java or gRPC Golang course.


In order to share knowledge I am not able to respond to private messages on Udemy. If you're a student, please ask questions inside the course. Thanks for understanding!

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.