Master of Databricks Asset Bundle (DataOps)

Name: Master of Databricks Asset Bundle (DataOps)
Rating: 4.6 (98 reviews)

Automate and Deploy Databricks Workflows with Asset Bundles (DAB) and CI/CD Pipelines

Created byGlib Martynenko

Last updated 7/2025

English

What you'll learn

Understand Databricks Asset Bundles (DAB) and CI/CD Concepts
Master Asset Bundle CLI and YAML Configurations
Manage Tasks, Dependencies, and Variables in Asset Bundles
Implement CI/CD Pipelines for Databricks Using GitHub Actions

Course content

12 sections • 37 lectures • 5h 18m total length

Welcome & Course Overview2:13

Databricks CLI installation9:29
Initializing Your First Asset Bundle7:16
Initialize your first Databricks asset bundle to auto-generate templates, deploy code and configuration as code, and set up a Databricks job across dev and prod environments.
Understanding Asset Bundle CLI Commands12:07
Master the Databricks asset bundle CLI commands to validate configurations, view bundle summaries, deploy to dev or prod, open jobs in the UI, and safely destroy resources within CI/CD pipelines.
How to find information about YAML Structure of Asset Bundles8:45
Explore how to locate yaml asset bundle parameters by inspecting the json schema linked from the yaml and identify triggers and time unit options.

Setup first repo and integrate it with the existing code8:23
Learn to set up a databricks asset bundle project with git integration, choosing GitHub for version control, and push changes from local to remote through two setup approaches.
Repository first and code later8:18
Integration GIT with Databricks5:49
Integrate GitHub with Databricks to synchronize notebooks and source code using personal access tokens, create a GitHub folder, and manage deployments via local environments and yaml workflows.

Substitutions or internal variables2:58
Explore substitution or internal variables in Databricks asset bundles, learn how to override and retrieve variables, and validate production targets with a JSON output.
Regular variable6:14
Override variable2:43
Complex variables9:27
Learn how to use complex variables to parameterize cluster configurations for multiple tasks in a Databricks job, organizing clusters in YAML files and referencing them in tasks with bundle validate.
Retrieval variables5:46

AzureDevOps pipeline with regular Databricks token16:08
Learn to deploy a Databricks Asset Bundle via an Azure DevOps pipeline using a token and a service principal, with yaml configuration and GitHub integration.
AzureDevOps pipeline with Azure service principal12:25
Deploy your Databricks asset bundle via an Azure DevOps pipeline secured by a service principal, onboarding it in Databricks accounts.

Requirements

Basic Knowledge of Databricks
Fundamental Understanding of YAML & CLI Tools
Version Control with Git (Optional but Recommended)
Python & Spark (Optional)

Description

Are you looking to streamline your Databricks workflows with automation and CI/CD? This course will take you from the fundamentals to advanced implementations of Databricks Asset Bundles (DAB)—a powerful tool for efficiently managing and deploying Databricks jobs.

Whether you're a Data Engineer, DevOps Engineer, Software Developer, or Architect, this course provides a hands-on approach to working with Databricks Asset Bundles, equipping learners with the skills to automate deployments, manage complex workflows, and implement CI/CD best practices in Databricks environments.

Through step-by-step demonstrations, you will learn how to:

Install and configure Databricks CLI to work with Asset Bundles.
Define, execute, and manage tasks and dependencies in DAB.
Work with DAB variables and parameters for dynamic workflows.
Integrate Git and GitHub Actions to automate deployments.
Implement a CI/CD pipeline to test and deploy your Databricks workflows.
Learn best practices for managing Databricks projects in production.

This course covers everything from setting up your first Databricks Asset Bundle to building full-scale deployment pipelines, making it ideal for both beginners and experienced professionals.

By the end of this course, you'll have the expertise to build scalable, automated Databricks workflows using Databricks Asset Bundles and industry-standard CI/CD techniques.

Join now and take your Databricks workflow automation skills to the next level!

Who this course is for:

Data Engineers & DevOps Engineers working with Databricks.
Software Developers interested in automating Databricks workflows.
Cloud & Data Architects looking to implement CI/CD in Databricks.
Beginner to Intermediate Databricks Users who want to streamline project deployments.

Master of Databricks Asset Bundle (DataOps)

What you'll learn

Explore related topics

Course content

Introduction1 lecture • 2min

CI/CD Overview2 lectures • 7min

Getting Started with Asset Bundles4 lectures • 38min

Task Execution and Dependencies2 lectures • 13min

Integration with Git3 lectures • 23min

Databricks Asset Bundles variables5 lectures • 27min

Databricks Asset Bundles parameters4 lectures • 31min

Implementation CI/CD GitHub Action pipeline2 lectures • 17min

Implementation CI/CD with Azure DevOps pipeline2 lectures • 29min

Python notebook end-to-end project4 lectures • 43min

Requirements

Description

Who this course is for: