Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Build Realtime Data Dashboard With AWS,Python,Kafka,Grafana
Rating: 5.0 out of 5(6 ratings)
1,020 students

Build Realtime Data Dashboard With AWS,Python,Kafka,Grafana

Beginner-friendly, step-by-step project to stream, store, and visualize data using AWS EC2, Python, Kafka, SQL & Grafana
Created bySunghwan Ki
Last updated 12/2025
English

What you'll learn

  • Build a fully functional real-time data dashboard from scratch—no prior experience required.
  • Learn step-by-step how to collect, stream, store, analyze, and visualize live data using AWS EC2, Kafka, PostgreSQL, Paython and Grafana.
  • Master essential Linux commands, learn how to collect real data using Python APIs, and build confidence with core SQL by analyzing live streaming datasets.
  • Build a real-time analytics project to showcase in your technical portfolio.
  • Gives you practical experience with AWS EC2, Kafka, Python, SQL, PostgreSQL, and Grafana.

Course content

7 sections32 lectures2h 10m total length
  • Introduction4:32

    In this lecture, you’ll learn how modern data systems work by building a real-time crypto dashboard from scratch. We’ll use AWS EC2, Python, Kafka, PostgreSQL, and Grafana to collect, stream, store, and visualize live Bitcoin and Ethereum prices. Even if you're a complete beginner, you’ll follow each step easily and understand how data flows across an end-to-end pipeline in real time.


    After completing this lecture, you will be able to:

    • Collect live crypto prices using Python and a real API

    • Stream real-time data through Kafka

    • Store structured data in PostgreSQL

    • Build an auto-updating dashboard in Grafana

    • Understand how data is collected, moved, stored, and visualized in a real-world system

  • [Important] Course Resources and AWS EC2 Guidelines1:09

Requirements

  • There are no strict prerequisites — this course is designed to be beginner-friendly.

Description

This course is designed for absolute beginners and early learners who want to understand real-time data—without needing any cloud, engineering, or programming background.


If you’ve been curious about AWS, Kafka, PostgreSQL, Python, or Grafana dashboards, this is the most beginner-friendly and practical way to start. You will follow a clear, step-by-step process and build a complete real-time crypto dashboard from scratch.


We focus on hands-on learning. Every section includes real activities, copy-and-run commands, and quizzes to reinforce your understanding. By the end of this course, you will not only understand how real-time pipelines work, but also have a fully functioning project running on AWS.


What This Course Covers

Section 1 — Introduction

Overview of the course, downloadable resources, and important AWS EC2 setup guidelines to ensure a safe learning environment.

Section 2 — Getting Started with AWS

Learn how to create your AWS account, launch your first EC2 instance, and safely stop resources to avoid additional charges. Includes guided activities and a review quiz.

Section 3 — Linux Essentials & Python Environment

Set up your Python virtual environment, learn basic Linux commands, and understand how API-based data collection works. Includes hands-on practice and a quiz.

Section 4 — Python Crypto Price Collector

Build your first Python script that collects live BTC and ETH prices every two minutes. Learn API calls, JSON handling, timestamps, and continuous execution.

Section 5 — Kafka & Streaming Fundamentals

Understand how Kafka and ZooKeeper work, how topics are created, and how producers and consumers exchange data. Install and configure Kafka, and stream real crypto prices into a Kafka topic.

Section 6 — PostgreSQL & SQL Commands

Install PostgreSQL, create databases and tables, and store Kafka messages in real time. Run SQL queries, compute 24-hour trends, and build a prediction pipeline using Python and SQL.

Section 7 — Build Grafana Dashboard

Install Grafana, connect it to PostgreSQL, and create visually appealing real-time dashboards. Build charts for price trends, predictions, 24-hour highs and lows, and more.


By the End of This Course, You Will Have Built:

- A complete real-time crypto pipeline

- Live data streaming from Python to Kafka

- Real-time storage inside PostgreSQL on AWS

- Interactive dashboards in Grafana

- BTC and ETH trend visualizations

- 24-hour high/low and price-change panels

- A prediction dashboard using Python and machine learning

- A professional, portfolio-ready project


Why This Course Is Perfect for You

- No cloud experience required

- No data engineering background needed

- No prior experience with Kafka, SQL, or Grafana

- Clear, beginner-friendly explanations

- 100% hands-on, step-by-step learning

- Builds a real, production-style system on AWS


If you’ve always wanted to understand how modern data pipelines work but didn’t know where to start, this course is the easiest and most practical way to begin.


Let’s build your first real-time dashboard together.

Who this course is for:

  • This course is great for beginners, students, career changers, or developers who want real hands-on experience with tools like Kafka, Python, SQL, and AWS. If you want to learn how modern data systems work and build a full real-time pipeline from scratch, this course is for you.