Terraform Snowflake from Scratch

Name: Terraform Snowflake from Scratch
Rating: 4.3 (48 reviews)

Complete guide to Managing Snowflake with Terraform

Created byJeremy Holtzman

Last updated 12/2021

English

What you'll learn

Connect Terraform to Snowflake
Run Terraform plans and applies
Create and manage Snowflake objects with Terraform
Grant privileges on Snowflake objects to roles using Terraform
Create custom modules to manage Snowflake objects with Terraform at scale
Advanced Terraform features including imports, moves, and removes
How to set up and use Terraform Cloud
Proper Snowflake authentication with Key Pair or OAuth
Connecting Terraform to Github to view plans before merging in
Managing a DEV and PROD Snowflake account with Terraform
Terraforming Snowflake best practices

Course content

5 sections • 35 lectures • 10h 26m total length

Introduction1:16
Installations4:32
Snowflake signup: https://signup.snowflake.com/
Install Terraform: https://learn.hashicorp.com/tutorials/terraform/install-cli
Connecting Terraform to Snowflake11:17
General Snowflake Documentation: https://docs.snowflake.com/en/
General Terraform Documentation: https://www.terraform.io/docs/index.html
Chan Zuckerberg Terraform Provider: https://registry.terraform.io/providers/chanzuckerberg/snowflake/latest
Managing Account Objects12:50
Snowflake Objects: https://docs.snowflake.com/en/user-guide/security-access-control-overview.html#securable-objects
Chan Zuckerberg Documentation: https://registry.terraform.io/providers/chanzuckerberg/snowflake/latest/docs
Practice Account Objects
Managing Schema Objects18:54
Chan Zuckerberg Documentation: https://registry.terraform.io/providers/chanzuckerberg/snowflake/latest/docs
Practice Schema Objects
Granting Account and Schema Objects21:10
Snowflake Access Control: https://docs.snowflake.com/en/user-guide/security-access-control-overview.html#access-control-framework
Practice Account and Schema Grants

Configuration Variables6:49
Terraform Variables: https://www.terraform.io/docs/language/values/variables.html
Resource References6:03
Terraform References: https://www.terraform.io/docs/language/expressions/references.html
Resource References Assignment
Warehouse Module13:31
Terraform Modules: https://www.terraform.io/docs/language/modules/index.html
Maps, For Each, and more Warehouse Module10:03
Terraform For Each: https://www.terraform.io/docs/language/meta-arguments/for_each.html
Terraform Maps: https://www.terraform.io/docs/language/expressions/types.html#map
User Module27:22
Fix User Module References
Database Module29:01

Terraform Imports and Removes Intro16:36
Terraform Imports: https://www.terraform.io/docs/cli/commands/import.html
Terraform Remove: https://www.terraform.io/docs/cli/commands/state/rm.html
Imports and Removes Continued9:44
Import and Removes practice
Terraform State Moves16:21
Terraform Move: https://www.terraform.io/docs/cli/commands/state/mv.html
Terraform State Move Practice
Terraform Refresh Options6:03
Terraform Refresh: https://www.terraform.io/docs/cli/commands/refresh.html
Terraform Graph and Output10:09
Terraform Graph: https://www.terraform.io/docs/cli/commands/graph.html

Roles Module8:39
Roles Module Update
Masking Policy Module19:03
NOTE: free Snowflake accounts don't have the ability to use masking policies. This lecture will still show you how you could set up the masking policy module, but feel free to skip it if you're not interested in learning masking policies.
Snowflake Masking Policies: https://docs.snowflake.com/en/user-guide/security-column-ddm-intro.html
Storage Integration Module13:34
Snowflake Storage Integrations: https://docs.snowflake.com/en/sql-reference/sql/create-storage-integration.html
Task Module15:50
Snowflake Tasks: https://docs.snowflake.com/en/sql-reference/sql/create-task.html
*UPDATE SNOWFLAKE ACCOUNT IF IT EXPIRES11:33
Resource Monitor Module6:42
Snowflake Resource Monitors: https://docs.snowflake.com/en/user-guide/resource-monitors.html
Module Wrap Up2:56

Starting Terraform Cloud15:47
Terraform Cloud: https://www.terraform.io/docs/cloud/index.html
Finish Setting Up Terraform Cloud22:17
Revisiting Resource Monitor Module15:57
Deploying Changes with Terraform Cloud
Integrating with Github15:02
Integration Terraform with Github: https://learn.hashicorp.com/tutorials/terraform/github-actions
Updating Github Check
Key Pair Authentication for your Snowflake User15:47
Snowflake Key Pair Authentication: https://docs.snowflake.com/en/user-guide/key-pair-auth.html
Authenticating Terraform User with OAuth47:10
Snowflake OAuth: https://docs.snowflake.com/en/user-guide/oauth-intro.html
Snowflake OAuth How To: https://community.snowflake.com/s/article/HOW-TO-OAUTH-TOKEN-GENERATION-USING-SNOWFLAKE-CUSTOM-OAUTH
URL Encoder: https://www.urlencoder.org/
Update Database Module40:31
Future Grants29:26
Snowflake Future Grants: https://docs.snowflake.com/en/sql-reference/sql/grant-privilege.html#future-grants-on-database-or-schema-objects
Setting up Dev Environment Part 137:37
Setting up Dev Environment Part 228:04
Deploying with Dev and Prod Environments6:24

Requirements

SQL
git
Ability to work in the command line

Description

Background

Terraform is an incredibly powerful tool to manage infrastructure, especially Snowflake. The first few sections in this course set you up with the fundamentals for success, while the advanced sections in the end provide more details on completely building out your architecture.

The price of the course is based on the time and effort put into it, but at the same time, I want it to be affordable for all. If the price is an issue, please reach out and I'll be happy to figure it out with you.

What you'll learn

By the end of the class, you'll have completely connected your own Terraform and Snowflake accounts following best practices, and you'll be able to manage your Snowflake objects (users, roles, warehouses, databases, etc.) with Terraform. Some of these skills you'll gain include:

Manage all types of Snowflake objects using modules that can easily be reused
Grant privileges on all of these objects, including future grants that simplify the management of databases and schemas
Creation and management of roles in a hierarchical structure to simplify grants
Ability to import existing Snowflake objects into your Terraform configuration
Setting up a DEV and PROD Snowflake account, and using GitHub to manage it all

Why you should use Terraform to manage your Snowflake account

Snowflake is an incredible data warehouse critical to thousands of organizations. But effectively managing Snowflake at scale has been difficult, until we start taking advantage of Terraform.

Some of the benefits of using Terraform with Snowflake include:

Speeding up manual and repetitive tasks
Standardization of roles and privileges
Auditability of privileges
Code review for the management of Snowflake objects

Essentially, Terraform allows you to use Infrastructure as Code to manage your Snowflake account. The state of Snowflake objects is controlled by the configuration you set up in Terraform, which makes it simple to manage.

About Terraform

Terraform is an open-source infrastructure as code software tool that provides a consistent CLI workflow to manage hundreds of cloud services. Terraform codifies cloud APIs into declarative configuration files. There is a specific provider plugin that allows you to manage your Snowflake account with Terraform.

Who this course is for:

Data Engineers looking to manage Snowflake with Terraform
Data Analysts and Data Scientists looking to manage components of their Snowflake environment with Terraform

Terraform Snowflake from Scratch

What you'll learn

Explore related topics

Course content

Introduction6 lectures • 1hr 10min

Modules6 lectures • 1hr 33min

Advanced Features5 lectures • 59min

More Modules!7 lectures • 1hr 18min

Best Practices11 lectures • 4hr 34min

Requirements

Description

Who this course is for: