Skip to content

Manage Test Suites

Create, edit, and delete the test suites that organize the data quality tests for a table group.

Tip

You can also create a test suite as part of the Add Connection or Add Table Group wizards.

Prerequisites

  • A table group. Use an existing table group or create a new one from the Table Groups page.
  • To generate tests when you create the test suite, the table group must have been profiled.

Create a test suite

These steps create a test suite of the Standard type. For the Contract type, see Create a contract.

  1. Select Test Suites from the menu.
  2. Click Add Test Suite.
  3. Under Type, select Standard.
  4. Enter a Test Suite Name, unique within the project, and an optional Test Suite Description.
  5. Select the Table Group for the test suite.
  6. Optional. Set a Severity to override the default severity of each test type.
  7. Optional. Select Export to Observability to export the suite's results to DataOps Observability. To set a custom component, expand Observability overrides and enter a Component Key and Component Name.
  8. Optional. Select Exclude from quality scoring to keep the suite's results out of the quality scores.
  9. Optional. Select Automatically deactivate tests that fail validation. See Tests that fail validation.
  10. Click Next.
  11. To generate tests now, keep Generate tests for the test suite selected and choose one or more Generation Sets. To add the test suite without tests, clear the checkbox.
  12. Click Add.

Edit a test suite

Select Test Suites from the menu, and click the (edit icon) on the test suite you want to modify. Make changes as needed, and click Save.

The Type and the Table Group cannot be changed. When you rename a test suite, update any scripts that refer to it by name.

Copy a test suite ID

The API identifies a test suite by its ID. Select Test Suites from the menu, and click the (copy icon) on the test suite.

Delete a test suite

Warning

Deleting a test suite permanently removes its test definitions, test runs and results, schedules, job history, and notification rules. Deleting a contract also removes its versions. This action cannot be undone.

Select Test Suites from the menu, and click the (delete icon) on the test suite you want to remove. Confirm the deletion.

Reference

Tests that fail validation

At the start of each test run, TestGen checks that the tests can still run against the data.

  • The test's table and columns exist.
  • The column's data type still fits the test. For example, a Maximum Value test applies to numeric columns, so it fails validation when its column changes to text.

A test that fails validation does not run. It gets an Error result whose message names the problem.

What happens next depends on the test suite's Automatically deactivate tests that fail validation setting. A contract has no such setting, and its tests report an error on each run.

  • Not selected (the default for test suites you create): The test stays active and reports an error on each run. After the table, column, or data type is restored, the test runs normally.
  • Selected: The test is deactivated, and it does not run again until you activate it.

Next steps

  • Generate Tests to populate the test suite from profiling results
  • Run Tests to run the test suite against your data