Snowflake Masterclass[Cortex AI+demos+Best practices+Labs]

Module one of the snowflake masterclass covers architectures, basics, virtual warehouse, and performance optimization. Learn environment setup, caching, clustering, dashboards via the user interface, and query acceleration and search optimization.

Create a Snowflake trial account, select the business critical edition on AWS, choose a region to minimize data transfer costs, and log into the Snowflake web console.

Introduces the Snowflake web console, showing worksheets, dashboards, data, marketplace, admin, and help tabs. Explains sharing, charts, data access, activity history, and role switching.

Learn to create a Snowflake database named demo db, explore the information_schema and public schema, and build an employee table with sample data for practical demos.

Explore Snowflake architecture, including data storage, virtual warehouses, and cloud services on AWS S3, and how time travel and zero-copy clone enable cost-efficient query processing.

Examine shared disk architecture and why a single shared disk becomes a bottleneck as nodes scale, complicates data consistency, and limits communication, contrasting with shared nothing solutions.

Explains shared nothing architecture by contrasting it with a shared disk bottleneck and allocating storage per compute node. Discusses data shuffling, node failure impact, and storage–compute balance challenges.

Examine the problems of shared nothing architecture when heterogeneous workloads meet homogeneous hardware, including membership changes and software upgrades that limit elasticity and availability.

Revisit Snowflake architecture by examining data storage and compute separation, coordinated by the cloud services layer that submits queries to the virtual warehouse in a scalable multi-cluster setup.

Leverage Snowflake's architecture to process huge data volumes with simple SQL queries, avoiding backups, query optimization, indexes, and memory concerns. Learn to reduce cost and storage when working with Snowflake.

Explore demos to understand Snowflake architecture better and see how data processing happens under the hood. Learn how architecture layers interact and how caching works in Snowflake.

Explore Snowflake caching mechanisms across cloud services, virtual warehouses, and data storage layers, showing how query results are reused via result cache and local disk caching.

From this architecture demo, learn to use a virtual warehouse for queries, avoid select star on large tables, set a limit, and adjust auto suspend.

Learn how snowflake's cloud services cache is invalidated by updates and when results are pulled from storage, with cached results saved for 24 hours and shared across users.

Explore clustering in Snowflake, learning how clustering works under the hood and how micro partitions are created, with demos and insights into query processing, dos and don'ts, and potential drawbacks.

Submit a query to Snowflake, where cloud services optimize the plan, assign work to virtual warehouses, prune micro partitions by metadata and filters, and enable selective column loading with clustering.

Discover micro partitions in Snowflake and how loaded data forms immutable table files. These partitions use columnar storage with PACs compression and include headers with column offsets and min/max values.

Explore micro partition depth in Snowflake by examining overlapping partitions, how depth drives clustering decisions, and the concept of constant micro partitions.

Create a clustering key on a Snowflake table by segment to enable automatic micro-partition grouping, then extend with additional keys using substring and to date conversions.

Learn to check a table's clustering information using Snowflake to view micro partitions, depth, and distribution, and evaluate clustering keys and potential reclustering impacts.

Demonstrates how clustering by segment reorganizes micro partitions after data load, using clustering information to watch depth in real time and understand backend compute costs.

Discover how to improve Snowflake performance by loading data with an order by on key columns, avoiding clustering operations and saving costs on micro partitions.

Explore how Snowflake micro partitions create table files, how the platform processes queries in a virtual warehouse, and how clustering works, including depth and key selection by cardinality.

Learn how to create and configure Snowflake virtual warehouses, including standard vs snowpark optimized types, auto scaling with min and max clusters, and the maximized mode.

Learn how Snowflake scales virtual warehouses with multi-cluster policies, including standard and economy modes, deciding when to spin up new clusters and when to suspend idle ones.