Teach on Udemy

Turn what you know into an opportunity and reach millions around the world.

Learn More

Your cart is empty.

Keep shopping

Linux IPC Project : Develop Asynchronous PUB-SUB System

Name: Linux IPC Project : Develop Asynchronous PUB-SUB System
Rating: 4.0 (5 reviews)

Inter-Process-Communication, Linux Dev Project, IPC, Distributed System, Socket Programming, C/C++ Project, Linux Course

Created byAbhishek CSEPracticals, Shiwani Nigam, Ekta Ekta

Last updated 3/2025

English

English [Auto],

What you'll learn

You will be able to Design Application which require IPC
Choose the best IPC mechanism depending on the application requirement
Understand Linux OS better and feel confident
Prepare for IPC based interview Questions
Design a Linux process which could harness benefits of various IPC Mechanism at the same time

Course content

9 sections • 44 lectures • 4h 7m total length

Know Your Course (KYC) and Pre-requisites3:33
High Level Project Explanation5:25
Pub-Sub System : Real World Usage Example6:09
Setup Development Environment5:28
Set up a development environment using git for version control, fork the course repository, and configure VS Code on Ubuntu for a C/C++ pub-sub project with Makefile automation and debugging.
Project Design in Detail13:32
Explore the design of a Linux IPC pub-sub system, detailing broker registration, unique IDs, publisher and subscriber databases, message distribution queues, and IPC channel choices for delivery.

The Three Components of Coordinator1:59
After the end of this section of the course, You can browse the snapshot of the code by following the below steps :

git clone <github URL to the pub-sub repo>
cd pub-sub
git reset --hard a1075840b136450e245cca5800edafb00d8dfa72
<now browse the code as you like >

To restore the code repo to latest, use git pull
Publisher Subscriber Data Structures12:31
Design coordinator data structures for publishers, subscribers, and their relationships, enabling registration, tracking of publisher and message IDs, and subscriber mappings in a linux ipc pub-sub system.
PUB-DUB-DB Mgmt APIs3:59
Assignment : Implement PUB-DUB-DB Mgmt APIs
Starting Coordinator Threads5:08
Launch the coordinator as a listener thread plus a configurable set of distribution threads using pthreads, handling a UDP port and preparing for message distribution to subscribers.
Setting up Makefile5:04
Display Coordinator DBs

Unified Communication Message1:24
After the end of this section of the course, You can browse the snapshot of the code by following the below steps :

git clone <github URL to the pub-sub repo>
cd pub-sub
git reset --hard 7cbb7a4e0c6290ef4afdd6760ac8bbb465b098a0
<now browse the code as you like >

To restore the code repo to latest, use git pull
Message Structure : cmsg_t10:15
Implement the cmsg_t structure in the common directory for a Linux IPC pub-sub system, detailing message id, type, sub type, priority, code, id, and a TLV buffer.
TLVs5:36
Attach is the tlv.h hdr file. Put it in Libs dir.
Operations on cmsg_t

Road-map for this Section1:05
After the end of this section of the course, You can browse the snapshot of the code by following the below steps :

git clone <github URL to the pub-sub repo>
cd pub-sub
git reset --hard df66e284134efc94e04e7e5ea40d017ae53c2e1c
<now browse the code as you like >

To restore the code repo to latest, use git pull
Starting Coordinator Listener thread14:53
Define TLVs and cmsg Operations
Publisher Registration8:37
Explain the publisher registration flow in a Linux IPC pub-sub system: parse the name TLV, update the coordinator's publisher database, and return a unique publisher ID.
Publisher Unregistration
Introducing Client Library6:26
Socket Publisher Example6:55
Client Lib APIs for (Un)Registration with Broker5:56
Implement client library APIs for (un)registration with the broker in a linux ipc pub-sub project, building a TLV-backed message and dispatching it to the coordinator.
Makefile Changes6:25
Testing Our Project2:27
Task : Complete the Subscriber Part

Publishing and Subscribing by Clients5:06
After the end of this section of the course, You can browse the snapshot of the code by following the below steps :

git clone <github URL to the pub-sub repo>
cd pub-sub
git reset --hard 7ff3e5e5f5e1ef4378795edecf97ca04ddede191
<now browse the code as you like >

To restore the code repo to latest, use git pull
Coordinator : Processing Publish & Subscribe Requests1:45
Implement coordinator changes to handle sub message add and delete for both publisher and subscriber, introducing publisher publish/unpublish and subscriber subscribe/unsubscribe APIs that update the coordinator's databases.
Cross Check your Code
Update Publisher Skt And Subscriber Skt Example Code6:37

Goals of this Section3:17
This section outlines building a distribution system for an asynchronous pub-sub setup, showing how the coordinator enqueues messages into distribution queues and how the distribution thread dispatches them to subscribers.
Message Distribution Design5:14
Creating CoordDistribution.cpp file1:54
Update Makefile :

COORDINATOR_OBJS=CoordinatorCore/coord_start.o \
CoordinatorCore/coordDb.o \
CoordinatorCore/coord_msg.o \
Common/cmsgOp.o \
CoordinatorCore/CoordDistribution.o

CoordinatorCore/CoordDistribution.o:CoordinatorCore/CoordDistribution.cpp
${CC} ${CFLAGS} CoordinatorCore/CoordDistribution.cpp -o CoordinatorCore/CoordDistribution.o
Message Distribution DataStructures8:41
Reference Counting on CMSG6:29
Msg Distribution : Enqueue and Dequeue fns4:40

Introduce New Codes
Publisher : Send SUB_MSG_DATA to Coordinator4:47
Publishers send data messages to the coordinator for distribution by the message distribution system, using SUB_MSG_DATA with type 100 and a TLV payload, bridged by a coordinator API.
Coordinator : Initialising Distribution Queues Instance(s)8:48
The coordinator launches a listener and multiple distribution threads, creates distribution queues, and uses a round-robin scheme to dispatch messages to subscribers, enabling load-balanced pub-sub distribution.
Coordinator : Processing SUB_MSG_DATA6:31
Test our Project5:07
After the end of this section of the course, You can browse the snapshot of the code by following the below steps :

git clone <github URL to the pub-sub repo>
cd pub-sub
git reset --hard bbceea14d92cd10ac995e14751851e93fa895291
<now browse the code as you like >

To restore the code repo to latest, use git pull

Defining ipc_struct_t8:06
After the end of this section of the course, You can browse the snapshot of the code by following the below steps :

git clone <github URL to the pub-sub repo>
cd pub-sub
git reset --hard 68ebe3932eefe0751e8af082d024a26247d54aa6
<now browse the code as you like >

To restore the code repo to latest, use git pull
Defining IPC Enums
Subscriber : Reporting IPC Method to Coordinator3:28
Coordinator : Processing IPC Channel Request of Subscribers8:52
Coordinator : Completing coordinator_dispatch( ) Fn5:18
Enhancing sub_skt_example.cpp3:47
Enhance the subscriber socket example to register its IPC channel with the coordinator, wait for data messages, and decode TLV data in a final pub-sub demonstration.
Test Our Project2:26

Requirements

Basic C/C++ is essential
Basic knowledge Operating System shall be good
Zeal and Enthusiasm to learn

Description

Pub/Sub System in C/C++: Course Overview

Unlock the Power of Asynchronous Communication with Pub/Sub in C/C++

Welcome to this comprehensive course on designing and implementing a robust Publish-Subscribe (Pub/Sub) System using C/C++. This course is tailored for developers who aspire to master the principles of real-time messaging systems and understand how to build scalable, efficient, and loosely-coupled communication architectures from scratch.

What is a Pub/Sub System?

A Publish-Subscribe system is a messaging paradigm that decouples the sender (publisher) from the receiver (subscriber). It allows for seamless communication between multiple components by enabling subscribers to receive updates on topics they are interested in, without being directly tied to the publisher. This design is widely used in real-world applications like:

Messaging Systems: RabbitMQ, Kafka
Microservices Communication
IoT and Real-Time Event Systems

What You Will Learn

In this course, we’ll build a fully-functional Pub/Sub system using C/C++, covering every essential concept step by step:

Understanding Pub/Sub Fundamentals
- How publishers and subscribers interact through topics.
- Decoupling communication with message brokers.
Designing the Architecture
- Implementing message queues for efficient data flow.
- Managing subscribers and topic registries.
- Handling asynchronous communication and thread safety.
Building Core Components in C/C++
- Publisher: A module to publish messages to specific topics.
- Subscriber: A module to subscribe to topics and receive updates.
- Broker: The central hub to manage topics, deliver messages, and coordinate between publishers and subscribers.
Optimizing for Performance
- Implementing thread pools for parallel processing.
- Minimizing latency with efficient data structures.
Message Prioritisation:
- Allow publishers to assign priorities to messages.
- The distributor delivers higher-priority messages first to subscribers.
Heartbeat and Health Checks:
- Implement a heartbeat mechanism to check the liveness of publishers and subscribers.
- Detect and remove inactive entities automatically.
Dynamic Scaling:
- Add auto-scaling support to adjust resources based on system load.
Message Encryption:
- Encrypt messages to secure data in transit and at rest.

Who Should Enroll?

Developers interested in building high-performance messaging systems.
C/C++ Programmers seeking hands-on experience with real-world software design patterns.
Software Architects aiming to design scalable and maintainable systems.
Learners exploring the implementation of microservices and event-driven architectures.

Why Take This Course?

By the end of this course, you’ll have the skills and confidence to:

Design and implement your own Pub/Sub system in C/C++.
Understand the principles behind distributed messaging systems.
Solve real-world problems with efficient communication architectures.

Join now and start your journey towards mastering Pub/Sub systems in C/C++. Let’s build something amazing together!

Who this course is for:

Under graduate Computer Science Students
Post Graduate Students
Job Seekers in System programming Domain - Networking/Driver programming/Distributed Systems/IOT etc

Linux IPC Project : Develop Asynchronous PUB-SUB System

What you'll learn

Explore related topics

Course content

Introduction5 lectures • 34min

Coordinator : Setting Up the PUB-SUB Database Mgmt5 lectures • 29min

Common Message Structure3 lectures • 17min

PUB-SUB Registration / Unregistration8 lectures • 53min

(Un) Publishing and (Un)Subscribing Messages3 lectures • 13min

Coordinator : Message Distribution6 lectures • 30min

Coordinator Integration with Msg Distribution System4 lectures • 25min

IPC to Subscribers6 lectures • 32min

Appendix - A - TLVs4 lectures • 14min

Requirements

Description

Who this course is for: