Your cart is empty.
Keep shopping
Analytics Engineering: Build an End-to-End ELT Data Pipeline
New
17 students
Analytics Engineering: Build an End-to-End ELT Data Pipeline
Build a real-world ELT project with Python, SQL, DuckDB, dbt, automated testing, Streamlit dashboards and GitHub
Created byBluelime Learning Solutions
Last updated 9/2026
English
What you'll learn
- Build an end-to-end Analytics Engineering ELT pipeline from scratch.
- Generate realistic synthetic e-commerce datasets using Python, pandas, and Faker.
- Use DuckDB as a high-performance local analytical data warehouse.
- Load CSV datasets into DuckDB using dbt seeds.
- Build and organise dbt models using Bronze, Silver, and Gold data architecture.
- Create reusable staging models to clean, cast, rename, and standardise raw data.
- Build business-ready fact tables by joining and transforming multiple datasets with SQL and dbt.
- Calculate business metrics including gross revenue, total cost, gross profit, and profit margin.
- Implement automated dbt data-quality tests for unique, not-null, and accepted values.
- Run and validate dbt transformations and troubleshoot data-model issues.
- Query transformed DuckDB data with Python to verify business KPIs and analytical results.
- Build an interactive executive analytics dashboard using Streamlit and Plotly.
- Visualise revenue, profit trends, order performance, and product category performance.
- Structure an Analytics Engineering project using professional folders, models, tests, scripts, and documentation.
- Create a professional GitHub README documenting the project architecture, technology stack, data flow, and results.
- Use Git to initialise a repository, stage files, create commits, and manage project source code.
- Publish a completed Analytics Engineering portfolio project to a remote GitHub repository.
Explore related topics
Course content
8 sections • 22 lectures • 3h 34m total length
Requirements
- No prior Analytics Engineering or Data Engineering experience is required.
- Basic familiarity with computers and working with files and folders is helpful.
- Basic Python or SQL knowledge is helpful, but not essential, as the project is explained step by step
- A Windows, macOS, or Linux computer capable of running Python and the project tools.
- An internet connection for downloading and installing the required software and packages.
- A code editor such as Visual Studio Code.
- A free GitHub account for publishing the completed portfolio project.
- A willingness to learn by building a complete hands-on project from start to finish.
Description
Build a complete, hands-on Analytics Engineering project from start to finish using Python, SQL, DuckDB, dbt, Streamlit, Plotly, Git, and GitHub.
This course is designed for learners who want to understand how modern analytics pipelines work by actually building one. Rather than focusing only on theory, you will create a practical e-commerce ELT pipeline that takes data from its raw form through transformation and testing to business-ready analytics and an interactive executive dashboard.
You will begin by using Python, pandas, and Faker to generate realistic synthetic datasets containing customers, products, and orders. You will then use DuckDB as a fast, lightweight analytical data warehouse for the project.
Next, you will work with dbt — data build tool — to transform your data using a structured Bronze, Silver, and Gold architecture. You will create staging models to clean and standardise the data before building a business-ready fact table containing important calculations such as gross revenue, total cost, and gross profit.
Data quality is an essential part of Analytics Engineering, so you will also implement automated dbt tests to validate important rules including unique values, not-null values, and accepted values.
Once the transformation pipeline is complete, you will query the analytical warehouse using Python and calculate executive KPIs including completed orders, gross revenue, gross profit, and profit margin.
You will then turn your analytical data into business insights by building an interactive Streamlit dashboard with Plotly. The dashboard will include KPI cards, monthly revenue and profit trends, product category performance, and interactive data visualisations.
But the project does not end with the dashboard.
You will learn how to organise and document your project professionally. You will create a detailed README, document the project architecture and technology stack, configure a .gitignore file, and prepare the project for source control.
Finally, you will use Git and GitHub to initialise your repository, stage and commit your source code, connect to a remote repository, and publish the completed project online.
By the end of the course, you will understand how Python, SQL, DuckDB, dbt, Streamlit, and GitHub work together as part of a modern Analytics Engineering workflow.
Most importantly, you will finish with a complete, documented portfolio-ready Analytics Engineering project that demonstrates practical end-to-end skills you can continue developing and showcase on GitHub.
Who this course is for:
- Beginners interested in Analytics Engineering or Data Engineering who want to learn by building a complete hands-on project.
- Aspiring Analytics Engineers and Data Engineers looking to develop practical, portfolio-ready skills.
- Data Analysts who want to move beyond analysis and learn how data is generated, stored, transformed, tested, and prepared for reporting.
- Python and SQL learners who want to apply their skills to a realistic end-to-end data project.
- dbt beginners who want practical experience building staging models, business marts, and automated data-quality tests.
- Developers and technology professionals interested in learning modern ELT workflows using Python, DuckDB, dbt, Streamlit, and Plotly
- Students and career changers looking for a structured project that demonstrates modern Analytics Engineering concepts and tools.
- Anyone building a technical portfolio who wants to create, document, and publish an end-to-end Analytics Engineering project on GitHub.