
After completion of the course, you will understand the Redshift architecture, Launch your own Redshift cluster, Create S3 bucket, create AWS IAM user, create AWS VPC, master writing effective queries and tune queries for better performance.
Explore Amazon Redshift architecture: a petabyte-scale, fully managed data warehouse cluster with leader and compute nodes, parallel query execution, and data slices, enabling scalable, fast analytics via standard JDBC/ODBC connections.
Create schema and tables in Redshift for a demo database, manage users (create and drop), and load data from S3 with copy; use a manifest for parallel, multi-file loading.
Apply where predicates in sql to filter data on Amazon Redshift, using comparisons, in, like, ilike, and between, while handling case sensitivity and multiple conditions.
Sort the employees table by salary in ascending order with a select statement, or in descending order using the appropriate keyword for active employees filtered by location and name.
Explore aggregate functions in Redshift, including sum, count, min, max, and list aggregation, and learn how to group by location, use distinct, and format results with delimiters.
Use the having clause to filter grouped payroll data by location, selecting active employees with salaries over 500000, as shown for California and Chicago.
Master data transfer in Redshift by using select into, insert into, and alter table to copy, append, or create tables, with techniques for ignoring extra columns and filling nulls.
Explore how data moves between disk and memory in Redshift, highlighting columnar storage, selective column reads, and in-memory temporary tables to minimize I/O costs.
Explore how to use coalesce to return the first non-null value between primary and secondary customer names, and apply decode and case when patterns to handle nested nulls in redshift.
Understand how sort keys and distribution keys optimize redshift queries by block pruning with min/max maps, and compare compound versus interleaved sort keys.
Explore distribution styles in Amazon Redshift, including key distribution, even distribution, and all distribution, and how hashed values map data to cluster slices across nodes.
Define primary and foreign keys between customer and order tables, and create views in Amazon Redshift to query data from underlying tables.
Learn to configure Amazon Redshift workload management by creating query queues, including a super user queue, with up to eight queues and fifty slots, using the management console.
Configure workload management concurrency in Amazon Redshift, understand why concurrency levels matter, manage query queues like Q1, and prioritize faster queries while enabling up to five parallel queries.
learn how to manage workload with wlm user groups in Amazon Redshift, assign users to groups, route queries to specific queues, and view group membership and configuration.
Explore how Amazon Redshift workload management enables query hopping between queues, using Q1 and Q2, time thresholds, prerelease rights, and cancellations when limits are reached.
SELECT SCHEMA schemaname,
"table" tablename, table_id tableid, size size_in_mb,
CASE WHEN diststyle NOT IN ('EVEN','ALL') THEN 1 ELSE 0 END has_dist_key,
CASE WHEN sortkey1 IS NOT NULL THEN 1 ELSE 0 END has_sort_key,
CASE WHEN encoded = 'Y' THEN 1 ELSE 0 END has_col_encoding,
CAST(max_blocks_per_slice - min_blocks_per_slice AS FLOAT) / GREATEST(NVL (min_blocks_per_slice,0)::int,1) ratio_skew_across_slices,
CAST(100*dist_slice AS FLOAT) /(SELECT COUNT(DISTINCT slice) FROM stv_slices) pct_slices_populated
FROM svv_table_info ti
JOIN (SELECT tbl, MIN(c) min_blocks_per_slice, MAX(c) max_blocks_per_slice, COUNT(DISTINCT slice) dist_slice
FROM (SELECT b.tbl, b.slice, COUNT(*) AS c
FROM STV_BLOCKLIST b
GROUP BY b.tbl, b.slice)
WHERE tbl IN (SELECT table_id FROM svv_table_info)
GROUP BY tbl) iq ON iq.tbl = ti.table_id;
This course covers the Architecture of Redshift, Columnar vs Row oriented databases, Introduce you to the AWS VPC, IAM role, and S3 bucket creation. You can master the SQL with best practices and learn a few admin activities which help to build an effective data warehouse. This course introduces compression/encoding techniques. You can learn to implement Workload management and monitor and tune long-running queries.
I always noticed most of the data engineers are clueless about how data is retrieved from the database. Writing an optimized query is a must when dealing with big data, understanding the architecture and the movement of the data is very important to write the best query.
Without prior knowledge on SQL, you can master the SQL and become a pro with this short 2 Hour tutorial.