
Explore Amazon Redshift, a cloud data warehouse service offering scalable provisioning, massive parallel processing, serverless options, automatic maintenance, and near real-time analytics with secure AWS integrations.
Explore how AWS Redshift serverless auto-provisions and scales, paying only for use while you focus on insights; manage workloads with workgroups and namespaces, using RPU, VPC, subnets, and security groups.
Explore the Amazon Redshift serverless console with a tour of the query editor, workgroups and namespaces, data backups, zero-etl integration, monitoring metrics, data shares, and alarms.
Create an AWS redshift provisioned cluster using the dc2.large node with one node and default configuration. Load the tickit database and review the endpoint, ARN, storage, and permissions.
Explore the provisioned cluster console for AWS Redshift, compare it with serverless, and navigate cluster dashboards, metrics, monitoring, and configuration options like maintenance, schedule, and security.
Discover how columnar storage in AWS Redshift speeds analytical queries by storing data column-wise, reducing disk reads, and enabling parallel processing across nodes for better compression.
Redshift delivers high performance and scalability via a high-bandwidth network, multi-node parallel processing, and columnar storage, while harnessing query optimization, result caching, materialized views, and Aqua on RA3 for accelerated analytics.
For more details on unsupported features, data types and functions, check out the redshift documentation - https://docs.aws.amazon.com/redshift/latest/dg/c_redshift-and-postgres-sql.html
Demonstrates creating a SQL-based user defined function in AWS Redshift to concatenate first and last names with a space using a nested concat approach, and applying it in a query.
Explore how Redshift uses PL/pgSQL to implement stored procedures with decision logic, loops, and DDL/DML, improving performance by reducing remote calls, while noting 2 MB source size and 32 parameters.
Demonstrates creating and executing a sample stored procedure in Redshift using plpgsql to update the price paid for a sales ID, with error handling for missing records.
Create a mat_view_demo schema and a materialized view tickets_mv to cache event names and total sales for faster queries, and enable automatic refresh after updates.
Define custom sort keys in Redshift by creating a table with first name and last name as a compound, interleaved sort key, and use explain to assess query performance.
Create a redshift VPC connection in quicksight, configure subnets and security groups, validate and enable direct-query data sources, then build a sales visualization over time.
Enable public access for the Redshift cluster, create a security group for your IP, then connect with DBeaver from a local machine and run sample queries.
Use the copy command to load large data into Redshift from S3 or other sources in parallel, with optional encryption and compression and support for CSV, JSON, and Avro formats.
Load a tab-delimited sales file into a Redshift cluster using the copy command, after uploading to S3 and configuring an IAM role.
Discover how aws redshift s3 auto copy enables zero etl integration by triggering copy jobs from s3 events, with monitoring via system tables and a preview mode caveat.
Explore AWS glue, a serverless data integration service that discovers, prepares, and integrates data from multiple sources for analytics and ML, with interactive sessions, notebooks, data catalog, and ETL/ELT workflows.
Unload Redshift data to S3 with unload command, choosing delimited or fixed-width formats and optional gzip compression; a sample query, S3 URI, and IAM role enable parallel output across slices.
Amazon or AWS Redshift is a fast, easy to use, cost-effective, peta-byte level, cloud data warehousing solution. In this course we will learn multiple features of Redshift in a step-by-step approach. This tutorial is well supported by hands-on lab exercises and the set of Interview Questions.
The course is divided in following core areas
Overview - Brief introduction to AWS Redshift, Datawarehouse Systems & evolution of related technologies
Getting Started - We will get started on Amazon Redshift by loading and querying sample data. We will understand the bare minimum of redshift ecosystem including Redshift Console, Query Editor and Configurations needed to integrate an external SQL Client - DBeaver.
How does it work - We will jump into the core mechanics of Redshift where we will understand the core components, functions of redshift including Redshift Cluster, Nodes, Distribution Key, Sort Key, Results Cache, AQUA, RA3 Instances, etc.
Manage Data - We will move to manage data section where we will understand the redshift data types, data loading & data querying options, automated table design, stored procedures, materialized views and workload management.
AWS Services - In this section, we will understand some advanced features of Redshift including Redshift Spectrum, Redshift ML and Federated Queries. We will also understand the integration aspects of redshift with other AWS services such as data-lake formation, aws EMR, AWS glue, Amazon Kinesis, Amazon Quicksight, AWS Sagemaker, etc.
Manage Cluster - In this section, we will understand the management aspects of redshift including the basic cluster operations, snapshots as backups, monitoring, logging & data security.
Conclude - In the last section, we will understand the redshift cost and pricing, best practices, reading references, etc.
Updates
July 2023: Updated the course with AWS Redshift Serverless - Overview, Getting Started Guide, Management, Monitoring and Pricing.