Data Engineering — How to Build an ETL Pipeline Using SSIS

SQL Server Integration Services is a component of the Microsoft SQL Server database software that can be used to perform a broad range of data migration tasks. SSIS is a platform for data integration and workflow applications. It features a data warehousing tool used for data extraction, transformation, and loading .

ETL, which stands for extract, transform and load, is a data integration process that combines data from multiple data sources into a single, consistent data store that is loaded into a data warehouse or other target system.

An ETL pipeline is the set of processes used to move data from a source or multiple sources into a database such as a data warehouse or  target databases.

SQL Server Integration Service (SSIS) provides an convenient and unified way to read data from different sources (extract), perform aggregations and transformation (transform), and then integrate data (load) for data warehousing and analytics purpose. When you need to process large amount of data (GBs or TBs), SSIS becomes the ideal approach for such workload.

In this course you will learn how to build an ETL pipeline for database migration using SQL Server Integration Services (SSIS) in Visual Studio 2019.

We will create a SSIS package that will extract and transform data from a source database and then load the data into a target destination database.