Learn Apache Pulsar

Name: Learn Apache Pulsar
Rating: 4.6 (203 reviews)

Fundamentals & Tutorial

Created byMaria Hatfield, PhD

Last updated 10/2021

English

What you'll learn

Apache Pulsar theory and fundamentals
Apache BookKeeper theory and fundamentals
Installing and configuring Pulsar
Installing and configuring BookKeeper
Installing and configuring ZooKeeper
Running a real world example of Pulsar

Course content

4 sections • 31 lectures • 1h 42m total length

Welcome1:27
Learn Apache Pulsar through an introduction and fundamentals course that teaches how to install, configure, and run a real-world Pulsar example, guided by experienced instructors.
Pulsar features7:03
Here we describe the most important features of Pulsar and what sets it apart from other distributed messaging systems.
Outline & tips for success1:44
Explore Pulsar fundamentals, including how it works, its components, configuration considerations, and security recommendations, install Pulsar with ZooKeeper and BookKeeper, and run a stock market data example with downloadable code.
Quick message0:25
Explore Apache Pulsar fundamentals and theory in this quick message lecture. Review the course after each section and rate it to help new students decide and improve the learning experience.

Introduction to Pulsar Fundamentals & Theory1:23
This lesson provides a strong foundation for working with Pulsar. It covers how Pulsar's two-layer system works, includes background on several configurations, and reviews security features.
Pulsar Structure5:32
Pulsar uses a two-layer architecture with brokers as serving layer and bookies as storage layer, where each topic is owned by one broker and topics auto-create in namespaces and tenants.
Subscription Types4:31
Explore Pulsar’s four subscription types: exclusive, failover, shared, and key_shared—and how they balance message ordering and scalability in a topic.
Duplicate Messages2:37
Explore how Apache Pulsar guarantees against duplicates by at least once, at most once, and effectively once, with broker-level detection and 2.7.0 support including developer preview.
Schema Registry2:40
Discover how Pulsar's schema registry enables per-topic schema control with server-side and client-side type safety, storing schemas in BookKeeper and managing them via REST API.
Pulsar Functions2:24
Learn how pulsar functions handle simple processing tasks by consuming messages from topics, applying user-defined logic, and publishing results to a topic, such as counting words in social media reviews.
BookKeeper Basics5:27
Explore BookKeeper basics within pulsar, including ledgers, log entries, and their replication across bookies. Learn how ensemble size, write quorum, ack quorum, and cursors govern durability, latency, and consumer tracking.
Benefits of Two Layers3:01
Bookie Failure1:09
Learn how Apache Pulsar stores log entries in ledgers on bookies and maintains availability with three bookies; if one fails, the broker redirects writes to new bookie and auto-recovers data.
Tiered Storage1:36
ZooKeeper1:15
Apache Pulsar uses ZooKeeper as metadata storage, configuration management, and coordination. It monitors broker health, assigns the topic owner, and redirects reads and writes to the new broker.
Geo-replication1:27
Discover Pulsar geo-replication, a built-in feature that mirrors messages across multiple clusters using BookKeeper, with synchronous replication at the BookKeeper level and asynchronous replication across clusters.
Pulsar Security5:16
Explore Pulsar security features, including TLS encryption, certificate authorities, server-client key pairs, mutual authentication, ACLs, and Kerberos SASL JAAS.
Summary of Pulsar Fundamentals & Theory3:53
Check your understanding

Installing and Running Pulsar Introduction2:12
Install and run Pulsar using VirtualBox on any OS, configure Linux guests with ZooKeeper, BookKeeper, and Pulsar, and follow a real-world stock market data example with downloadable code.
Downloading & Installing VirtualBox1:03
In this video you will download and install VirtualBox to allow you to run Pulsar on any machine, whether you are running Windows, Linux, or macOS. There are captions available for the video. Use the captions to help you follow along.
Downloading & Installing Linux7:24
In this lecture we will download and install CentOS-7. There are captions available for the video. Use the captions to help you follow along.
Check your understanding
Operating System Parameters2:16
In this lecture we will configure operating system parameters such as swappiness. There are captions available for the video. Use the captions to help you follow along.
Check your understanding
Operating System Update & Guest Tools Installation2:37
In this lecture we will update the operating system and use Guest Additions to improve the ease of use for the virtual machine. There are captions available for the video. Use the captions to help you follow along.
Check your understanding
Additional VM and Connectivity8:22
In this lecture we cover connectivity and helpful tools to make installing and running Pulsar easier. There are captions available for the video. Use the captions to help you follow along.
Check your understanding
Installing ZooKeeper7:53
In this lecture we install ZooKeeper. There are captions available for the video. Use the captions to help you follow along.
Check your understanding
Installing BookKeeper4:48
In this lecture we install BookKeeper. There are captions available for the video. Use the captions to help you follow along.
Check your understanding
Installing Pulsar4:07
In this lecture we install Pulsar. There are captions available for the video. Use the captions to help you follow along.
Check your understanding
Changing Swap and Heap Sizes2:08
In this lecture we configure swap and heap sizes. There are captions available for the video. Use the captions to help you follow along.
Real World Example4:40
In this lecture we run a real world example of Pulsar using stock market data. There are captions available for the video. Use the captions to help you follow along.

Thank you0:42
Understand what sets Apache Pulsar apart from other distributed messaging systems. Install and configure Pulsar for a standard use case, then set up a real world project.
Next steps & contact information1:39
Explore upcoming mini courses to master Pulsar, including Pulsar functions for efficient processing and machine learning use cases, migration from Kafka to Pulsar, and monitoring and alerting for Pulsar.

Requirements

There are no requirements or prerequisites for this course.

Description

Learn the fundamentals of Apache Pulsar and understand its component parts, including Pulsar brokers and BookKeeper bookies. The course also covers basic configuration considerations and Pulsar security. The instructors lead students through downloading and installing Pulsar, and running a real world example of using Pulsar to move stock data. Whether you are using a Windows, Linux, or macOS computer, you can run the tutorial.

The course will begin with a deep-dive into the structure of Apache Pulsar, including a thorough review of all of its component parts (Pulsar brokers, BookKeeper bookies, ZooKeeper, etc.). The instructors also cover Pulsar functions, effectively once messaging, geo-replication, and security. Then students are guided through a comprehensive tutorial to install and setup Pulsar. The course ends with a real world project.

The instructors, Maria and Barry, have over a decade of combined experience with distributed messaging platforms, and together co-founded Dattell, a managed services and consulting company that offers support for Pulsar along with other technologies. They also have experience with use cases in a wide range of fields from finance to communications to SaaS, and many others.

The instructors also have over a decade of experience teaching at the university level, as well as to working professionals.

Who this course is for:

Developers, operational projectionals, and management interested in understanding the basic tenants of Apache Pulsar and how it can be used for low latency messaging applications.

Learn Apache Pulsar

What you'll learn

Explore related topics

Course content

Getting Started with Introduction to Pulsar4 lectures • 11min

Pulsar Fundamentals & Theory14 lectures • 42min

Installing & Running Pulsar11 lectures • 48min

Wrapping Up2 lectures • 2min

Requirements

Description

Who this course is for: