
Explore major Snowflake pitfalls, common misconceptions, and cost traps, from warehouses and data pipelines to SQL nuances, Cortex, and Snowflake programs for practical mastery.
Identify major Snowflake pitfalls and maximize learning with hands-on experiments, resources in SQL or Python, and slides, while building skills even if you’re new to Snowflake.
Explore free forever trial options, standard versus enterprise, VPS and business critical editions, and how data sharing and the marketplace work in Snowflake.
Learn how to sign up for a free Snowflake trial, choose editions and regions, activate the account, and explore databases, warehouses, and the SQL worksheet.
Choose between standard and enterprise editions by weighing per-credit costs, features, and your analytics needs, and consider data sharing through a private data exchange to optimize costs.
Understand Snowflake's money model through compute pricing and virtual warehouses, including idle costs, edition differences, and how pushing code, Python via Snowpark, and Streamlit apps affect spend.
Understand who pays for shared configurations in Snowflake, including reader, producer, and consumer accounts, and how data, code, and queries incur credits for virtual warehouses.
Explore Snowflake's evolution from a minimal data warehouse to a data cloud. See how ai data cloud, cortex, and llms shape previews, obsolescence, and continual updates.
Explore how Snowflake compute costs arise from idle warehouses, suspending decisions, and stuck queries. Compare typical and multi-cluster warehouses, and weigh managed versus serverless tasks to balance cost and speed.
Suspend idle warehouses to avoid costs, since starting or resuming incurs at least a one-minute bill, and Streamlit apps can keep warehouses up even when not executing queries.
Set auto suspend to one minute for newly created warehouses to avoid wasted costs, and understand UI and code defaults, resume and suspend, and consolidation to reduce expenses.
Learn how the default statement timeout can let long queries run for two days in snowflake, and how to cancel, suspend warehouses, or programmatically cancel queries to avoid credits.
Discover how larger Snowflake warehouses can make slow queries cost effective by reducing execution time, with total cost equal to warehouse size multiplied by execution time.
Understand how warehouse sizes differ from multi-cluster warehouses, with manual resize, scale up and scale out, and the role of concurrency and single-warehouse execution in Snowflake.
Compare serverless and managed Snowflake tasks for frequent, short queries, noting that serverless charges only execution time while managed warehouses stay up, with size and timeout defaults.
Explore data transfer, storage, and querying Snowflake data across tables and files. Understand micro-partitioning and clustering keys, data caches, query result caches, time travel, cloning, and secure data sharing.
Explore Snowflake data transfer costs: data in is free, data out is expensive. Use same provider and region or secure data shares to avoid duplication and costly regional replication.
Analyze how queries move data from RAM to SSD to blob storage, manage disk spilling and result caching, and leverage micro partitions and clustering keys.
Learn how to query data lake files directly from stages, compare external and internal stages, and optimize with partitions, parquet versus csv, and json with schema on read.
Explore time travel and fail-safe in Snowflake, including data retention time in days, defaults, and cost implications for stage and permanent tables.
Explore zero copy cloning in Snowflake, where clones share reference storage and changes create owned storage, with time travel and access policies for development and testing.
Learn secure data sharing in Snowflake, including sharing via secure views and secure functions from producer to consumer or reader accounts, with outbound shares and access privileges.
Explore Snowflake's role as a data warehouse, hybrid tables for fast reads and writes, primary keys, clustering keys, and Parquet-based data lake queries for performance.
Explore hybrid tables in Snowflake, compare them with permanent tables, and learn how they support both olap and oltp workloads, with enforced primary keys, referential integrity, and selective indexing.
Explore how Snowflake's OLAP tables handle table constraints: not null is enforced, but primary keys, foreign keys, and unique constraints are not. Distinguish regular from hybrid tables and how to query constraints for ER diagrams.
Learn when to use clustering keys in Snowflake, how to define cluster by on one or more columns, and how clustering information enables pruning of micro partitions for terabyte-scale tables.
Leverage parquet over csv in data lakes for snowflake analytics, reducing storage and data scanned while boosting speed; select file formats based on olap versus oltp.
Explore Snowflake data pipelines, including ingestion and integration architectures, CDC streaming outside of Snowflake, ETL to ELT with streams and tasks, and dynamic tables, using Fivetran, Airbyte, and Airflow.
Explore how to build continuous data pipelines in Snowflake using ELT, staging tables, the medallion bronze-silver-gold workflow, and data vault concepts.
Compare batch and streaming data pipelines, highlighting how initial batch transfers feed large datasets and CDC-driven streaming keeps Snowflake up to date with near real time.
Master change data capture in Snowflake using manual merge, change tracking, streams and tasks, and dynamic tables in an ELT workflow, tracking inserts, updates, and deletes from source to target.
Learn to build CI/CD pipelines inside Snowflake for data warehouses, covering database and schema change management, Git and API integrations, and ML pipelines with a model registry and feature store.
Learn how Snowflake evolved from a data warehouse to a data cloud and enables ml pipelines with Snowpark ml, Cortex, and a model registry for near-data training and serving.
Explore Snowflake SQL’s modern clauses and higher-order functions, and examine common pitfalls like confusing table and lateral usage and the nuances of JSON flattening.
Navigate legacy and modern SQL in Snowflake, from limit offset and offset fetch to window functions, qualify, pivot, dynamic pivot, and higher order functions like transform and flatten, and countif.
Explore snowflake scripting, focusing on store procedures, cursors, and result sets, while highlighting variable binding, execute immediate, and the quirks that complicate SQL as described.
Examine why SQL and Snowflake scripting produce confusing or useless error messages. Learn how misleading messages hinder debugging and how to interpret common syntax errors.
Explore the table keyword in Snowflake, including table literals and table functions in the from clause. Learn how wrapper, lateral, generator, and flatten support dynamic queries and table references.
Explore how the lateral keyword prefixes a correlated subquery or inline view in the from clause, clarifying it's not a join or a function, but a table expression prefix.
Explore the snowflake flatten function, a table function that explodes arrays and objects into rows, returning index, key, and value columns for JSON and semi-structured data.
Explore Snowflake APIs, including procedures, functions, UDFs, and UDTFs across SQL, Snowflake scripting, Python, and JavaScript. Review REST APIs, Snowpipe, Snowsight, and the Snowpark DataFrame API.
Explore stored procedures, user defined functions, and user defined table functions in Snowflake, compare sql and snowflake scripting languages and calling patterns, and understand return behavior and table result handling.
Learn how Snowflake rest APIs, including SQL rest API and Snowpipe rest API, enable programmatic access, with JWT or key-pair authentication and tools like curl or Postman.
Learn how the Pandas on Snowflake API processes large datasets by translating Pandas operations to sql, using Modin with Snowpark, and leveraging distributed warehouses with lazy evaluation and temporary tables.
Learn how snowpark runs python in snowflake via python worksheets, creating sessions, data frames, and stored procedures, and compare it with python connector and sql worksheets.
Explore configuring and running a streamlit app with snowflake, generating fake data via faker, and creating a public customers table from a test snowflake account.
Explore Snowflake Cortex by examining Snowpark vs Snowpark ML, SQL-based ML classes with stored procedures and UDF calls, time series forecasting vs anomaly detection, and hosting LLMs with OpenAI ChatGPT.
Trace the evolution from Snowpark to Snowpark ML, demonstrating lazy execution, a data frame API, parallelized algorithms, and a model registry within Snowflake.
Explore how Snowflake introduces object-oriented SQL with built-in classes, instantiating class objects, training ML models, and using classification, forecast, and anomaly detection workflows with stored procedures and evaluation metrics.
Explore Snowflake ml time series functions for forecasting and anomaly detection, showing how a single model can handle both tasks with prediction intervals.
Explore Snowflake Cortex built-in LLM functions such as complete, sentiment, summarize, translate, and extract, and learn how external access integrations enable secure OpenAI REST API use with ChatGPT.
Explore the realities of Snowflake programs, including SnowPro certifications, advanced exams, and Cortex, while evaluating customer support experiences and the evolution of product documentation.
Analyze Snowflake certification pitfalls, focusing on SnowPro Core as a prerequisite, high exam costs, pricing comparisons with AWS and Databricks, and concerns about outdated Cortex content and limited promotion.
Assess how too many expert programs in Snowflake impact credibility, exploring data superhero cohorts, SME certifications, and the risk of low-quality blogging from insiders.
explores a bad customer support experience with Snowflake, highlighting slow, unhelpful responses from a support team, a blocking billing issue, and a culture of secrecy and lack of transparency.
Identify pitfalls from Snowflake documentation overload and frequent changes that overwhelm quickstarts. Evaluate risks of over-adding concepts like RBAC and security layers for solo users.
If you already know Snowflake, you may not be aware of many traps I'll talk about in this original course. You cannot become an expert in Snowflake unless you learn about them. If you do not know Snowflake yet, here are some things you may struggle to properly understand.
This course will focus mostly on pitfalls. For in-depth knowledge of Snowflake, I'll leave pointers and references to other better sources. A few lectures will not have the typical hands-on experiments you will encounter in my other specialized courses. The minimal requirements are some basic SQL and Python programming skills.
What will be very valuable here to you is that I'll share my years of experience with Snowflake, to make you aware of pitfalls nobody else may tell you about. I learned about them the hard way. Avoid doing the same.
Credentials
The only world-class expert from Canada selected for the Snowflake Data Superhero program in 2021.
SnowPro Certification SME (Subject Matter Expert): i.e. dozens of exam questions have been created by me.
I passed five SnowPro certification exams, all from the first attempt: Core, Architect, Engineer, Analyst, Scientist.
Highly specialized in Snowflake for the past few years, as a Data and Solutions Architect in AWS, Azure and GCP.
I served dozens of clients working for Snowflake Partner companies or as an independent consultant.
Enroll today, to keep this course forever!
[Disclaimer: We are not affiliated with or endorsed by Snowflake, Inc.]