
Explore ingesting data into Snowflake using external tables from cloud storage, inserting into a target table, and streaming via streams for near real-time loads, without snowpipe, copy, or DBT.
Snowflake UDFs support SQL, Python, JavaScript, and Java. In practice, answer with SQL for UDFs and stored procedures unless you are confident in JavaScript or Java.
Airflow enables cross-system job dependencies that Snowflake tasks cannot, coordinating MySQL data load, Snowflake copy, and post-process archiving to S3 after successful ingestion.
Rely on cloud storage notifications; Snowpipe ingests new files and ignores files created before it. Load older files with a copy command, or alter pipe refresh covers only seven days.
Learn to monitor and troubleshoot snowpipe by checking pipe status, reviewing copy history, validating loads, fixing data issues, and restarting to process new files.
Suspend the failing task to prevent repeats, remove it from the task tree, perform table maintenance, fix and test changes, then resume the task with alter task remove after clause.
Demonstrate three use cases of tasks in a Snowflake project: daily storage metrics with a stored procedure, task-driven streams for CDC, and 60-minute refreshed reporting tables.
Learn how Snowflake's resource monitors manage credits in a metered service by setting limits, triggering alerts, and suspending warehouses to prevent excessive credit consumption from poorly written queries.
Snowflake allows one account-level resource monitor; warehouse-level monitors are possible, but a warehouse cannot belong to multiple account-level monitors, and thresholds trigger suspends and notifications as credit quotas are reached.
Explore the three internal Snowflake stages: user stage, table stage, and named internal stage, and learn how privileges, automatic creation, and loading data across stages work, including listing files.
Learn how to join a stream and a table in Snowflake using the join keyword for an append-only stream, and the merge command to consume updates, deletes, and inserts.
A 1 GB file arrives and must be ingested near real time. Snowpipe is unsuitable; create an external table, define a stream, and poll data into Snowflake.
Explore Snowflake streams as near real time change data capture to propagate inserts, updates, and deletes to a target table, and learn how to create streams with create stream command.
Do you worry when you need to go and attend a snowflake data engineer interview because of which you decide to not try new job opportunities
If this is you, you may have stumbled upon a solution to your challenge. This course the first of its type on udemy is designed to help folks like you to increase their confidence and get a dream job, a pay hike , remote work or maybe a better work environment
This course may help you get to the jobs of your dreams by increasing your confidence.
It covers several scenario question for senior Data Engineers.
Basic questions for Junior Engineers and everything else in between.
There are over 100+ question and answers in this course.
3+ hours of Interview questions , the most comprehensive course for interview questions on Udemy.
The topics covered in this course are below
LOADING DATA IN SNOWFLAKE
UDF AND STORED PROCEDURE
JOB SCHEDULING
SNOWPIPE
TASK
RESOURCE MONITOR
DATA WAREHOUSING
STAGES
STREAMS
TIME TRAVEL
FAIL-SAFE
ZERO COPY
CLONING
WAREHOUSE
UNLOADING DATA FROM SNOWFLAKE
DATA SHARING AND SECURE VIEW
COST SAVING
ARCHITECTURE
DYNAMIC DATA MASKING & ROW ACCESS POLICY
UNSTRUCTURED DATA
PERFORMANCE TUNING
INTERVIEW MANAGEMENT
EXTERNAL TABLES
MATERIALIZED VIEWS
MOCK DATA ENGINEER INTERVIEW
DYNAMIC TABLES
HYBRID TABLES
SNOWFLAKE SQL
EVENT TABLES
I have covered under Interview management
How to increase the interviewers confidence in you.
How to handle questions that you do not know.