Integrate io - The no-code data pipeline platform

Explore the no-code data pipeline platform's Xplenty interface, including connections, sources, transformations, and destinations, then run, schedule, and monitor data jobs with clusters and variables.

Create a new account, set up a dataset and a bucket, and build a schema for the employee details dataset in the no-code data pipeline platform.

Create and connect places, Typekit and PostgreSQL databases using the no-code data pipeline platform; configure street connections, test credentials, and prepare to move data in the next lecture.

Create a no-code migration package to move data from Amazon S3 to Postgres, configure source and destination components, map columns, and run the job for 107 records.

Migrate files from S3 bucket to Postgres database with no-code data pipeline flows, rename schemas and tables, map columns, and load data into countries, departments, employees, job history, and locations.

Explore the select transformation in the no-code data pipeline platform to manipulate data, concatenate names, and load the results into a Postgres destination.

Apply a sort transformation to an existing dataset by loading data from the select transformation table, sorting in ascending order (and multi-column options), and outputting to a new table.

Apply rank and dense rank transformations to a salary column from an S3 bucket, with and without sorting, and load the results into a Postgres database.

Apply the limit transformation to cap records and preview three rows, then partition data by department to show three records per department for data audit and test cases.

Utilize window transformation to perform partitioned analytics by department, generate windowed salary metrics, and apply lead and average functions to create insightful data views.

Explore sample transformation in Integrate io, learning how to limit source data by percentage and generate sample records for validation and testing, with 10% and 20% previews.

Join two datasets from an S3 bucket using the join transformation, explore inner, left, and full joins, optimize for skew, deduplicate columns, and load results into Postgres.

Explore cross join transformations in the no-code data pipeline platform to generate cartesian products by joining employees and departments, load data into a table, validate results, and complete the job.

Master clone transformation by replicating input data from an S3 bucket to multiple destinations, including a Postgres database and S3 storage, with validation and backup tables like clone transformation backup.

Explore union transformation in a no-code data pipeline on integrate io by creating a package, combining two sources including a Postgres database, and loading 58 records into the target.

Apply the filter transformation to a source dataset, selecting employees with salary greater than or equal to 10000 and choosing between all, any, or none of multiple conditions.

Explore asset transformation to trigger a job failure with a custom error message. Define a validation expression for example salary less than 10000 to fail the job and log details.

Explore aggregate transformations to perform counts, averages, minima and maxima, variance, and standard deviation, using group by department and by job on salary data. View distinct results.

Explore cube transformation within the no-code data pipeline by defining a cube, adding components, and applying aggregate functions like count and sum to roll up and validate data.

Explore the distinct transformation in the no-code io data pipeline platform, remove duplicates, and verify results by loading into a database to achieve unique country records.

Create an operation type package, extract data from a database, append it to a target table, validate results, and troubleshoot primary key conflicts that cause job failures.

Master operation type, override, truncate, and insert in the no-code data pipeline. The lecture shows truncating the table and inserting 107 records.

Overwrite data by deleting all rows in a table and inserting new rows, monitor the job progress, and verify the table after completion.

Merge existing data with delete and insert, using the primary key to identify records in the operation timetable, and address primary key constraint errors by replacing old records.

Merge existing data with update and insert operations in Integrate io, the no-code data pipeline platform. Run the job to apply changes and verify results in the table.

Explore the X console to define and test functions, such as scorecard, string-to-date, and custom formats, and to split and reverse data within the integrate io no-code data pipeline platform.

Create a cluster in the no-code data pipeline platform, select settings, and confirm that clusters are created.

Enable the automatically add missing columns option to load data from the employees table and automatically add new fields like job and salary, then save and validate.

Apply the where clause to filter records from a database using a class, selecting matching entries and verifying the table shows five records.

Create a new package, define a query as the data source, join employees with departments, jobs, locations, and countries, preview results, then run and validate the data load.

Explore pre-action and post-action sql workflows in the no-code data pipeline, loading data, inserting into tables, and updating job status through select, insert, and update statements.