
Learn how automation validations can be scheduled or triggered to control external jobs, enable root cause analysis, and execute events based on results via a command-line API.
Explore the alerting component of quali up, notify data stewards, track data quality over time, and publish results by outcome across Slack, Splunk, emails, and tickets.
Learn how to log in to quilliup using a tenant text input for security, enter your username, and sign out by selecting your user ID across screens.
Share test results via email by configuring recipients, using a default template with runtime variables, and optionally attach an Excel file for failed runs.
Understand how datasets are defined and compared, view and edit source data, and fetch data from relational queries, Excel, flat files, MongoDB, Cassandra, or API calls, then compare with dashboards.
Create a data validation test with an ad hoc dataset, define quick and user-defined rules via the expression editor, and run the data profile to verify price >= cost.
Learn how tags, color-coded boxes with text, are user-definable and can be added to any entity; create new tags and tag groups to organize by test type or context.
Create dynamic variables from a database table by converting a fixed email list into a single-value dynamic variable, using a query and dataset filters for runtime tests.
Explore dynamic variables in a simple project by using the query builder to create, filter, and concatenate fields, then sample data and evaluate single-value versus list-value results.
Create complex data sets by pasting a custom SQL query into the dataset builder, validate the query, select fields, and save your relational or RDBMS based dataset.
Differentiate library datasets from ad hoc datasets by using predefined library data that cannot be edited in tests, but can be copied or added to the shared library.
Create and customize an existence test to verify a record in a dataset by filtering a library data set, adjusting the threshold, and logging results to Splunk.
Learn to define thresholds by the number of rows returned, using a highest threshold where zero passes, one warns, and more than one fails.
log test results to a database table by selecting a predefined datasource and schema, enabling logging to create summary and details tables for each test id.
Learn to create a KPI range test by selecting a KPI rule, configuring group by entity with row counts, and applying thresholds to define success or failure.
Understand how versioning saves and restores previous test versions, highlights changes, and lets you keep or discard updates to avoid mistakes.
Enable and configure scheduling for execution flows with the scheduler button, set start and expiration dates, options like weekdays at 5 am, or a custom cron expression.
Create a Linux acmd script by typing commands directly into the shell, unlike Windows, verify them there first, then copy and paste into the script box and save.
Create and run a script to execute a create schema against a database, using a command line script type, selecting a data source, and using dynamic variables to generate schemas.
Create and manage SQL query scripts for a relational data source, including adding, editing, and deleting scripts. Learn how to run scripts with or without output on the bascule server.
Explore the full monitor to view KPI boxes, filter by status, and use auto-refresh with favorites for access; open test results and search by name, id, flow, script, or tags.
Create tag groups and tags by adding a tag group with a name and color, then add tags, test colors on text, and save for use.
Create network locations as data sources for flat files and Excel validation, configure a root path in system settings, and test the connection before adding files.
quilliup is a data quality platform, running as a web application, which comprises multiple modules. Quality Gates, the main module, will be the focus of this course. Quality Gates increases and maintains data quality, decreases cycle time, and automates manual processes. Quality Gates has advanced alerting features and can integrate with any ecosystem, including those using other monitoring platforms like Splunk. The Quality Gates validation methodology consists of three steps: test, automate, alert. This course will guide you through every aspect of Quality Gates.
Future sections will illuminate the other modules in quilliup.