Skip to content

Manage Test Suites

A test suite organizes data quality tests for a table group. Once created, you can generate tests to populate the suite and then run the tests on a recurring basis.

Tip

You can also create a test suite as part of the Add Connection or Add Table Group wizards.

Prerequisites

A table group is required. Use an existing table group or create a new one from the Table Groups page.

Create a test suite

  1. Select Test Suites from the menu.
  2. Click Add Test Suite.
  3. Enter a Test Suite Name and optional Description.
  4. Select the Table Group for the test suite.
  5. Optional. Set a Severity override. This overrides the default failure severity set by the test types themselves.
  6. Optional. Set up a custom DataOps Observability mapping by toggling on Export to Observability and entering a component key and name.
  7. Optional. Select Automatically deactivate tests that fail validation. See Tests that fail validation.
  8. Click Add.

Note

A new test suite has no tests until they are generated or manually defined. Continue with Generate Tests to populate the suite.

Edit a test suite

Select Test Suites from the menu, and click the (edit icon) on the test suite you want to modify. Make changes as needed, and click Save.

Copy a test suite ID

The API identifies a test suite by its ID. Select Test Suites from the menu, and click the (copy icon) on the test suite.

Delete a test suite

Warning

Deleting a test suite permanently removes all associated test definitions and test results. This action cannot be undone.

Select Test Suites from the menu, and click the (delete icon) on the test suite you want to remove. Confirm the deletion.

Reference

Tests that fail validation

At the start of each test run, TestGen checks that the tests can still run against the data.

  • The test's table and columns exist.
  • The column's data type still fits the test. For example, a Maximum Value test applies to numeric columns, so it fails validation when its column changes to text.

A test that fails validation does not run. It gets an Error result whose message names the problem.

What happens next depends on the test suite's Automatically deactivate tests that fail validation setting.

  • Not selected (the default for test suites you create): The test stays active and reports an error on each run. After the table, column, or data type is restored, the test runs normally.
  • Selected: The test is deactivated, and it does not run again until you activate it.

Test suites that exist when you upgrade to a TestGen version with this setting have it selected.

Generate Tests

Run Tests

Manage Table Groups