Skip to content

Test Definitions

View and manage the individual tests in a test suite — review auto-generated tests, tune parameters, add manual tests, and control which tests run during execution.

Test definitions sit between test generation (which auto-creates definitions from profiling results) and test execution (which runs them against your data). This is where you fine-tune what gets tested and how.

Prerequisites

A test suite with generated or manually created tests. To populate a test suite automatically, see Generate Tests.

  1. Select Test Suites from the menu.
  2. On a test suite, click N test definitions to open the list of test definitions for that suite.

Review and filter tests

The test definitions grid displays all tests in the suite. Each row shows the test's table, column or focus area, test type, and status flags such as Active, Locked, and Export to Observability.

Use the filters at the top of the grid to narrow the list by Table, Column, or Test Type. Click any row to view the full test definition details in the side panel.

Edit a test definition

To adjust thresholds, expected values, or other parameters after reviewing test results:

  1. Select the test definition to open the detail panel.
  2. Click Edit.
  3. Modify the parameters as needed.
  4. Click Save.

Note

The test type, schema, and test suite cannot be changed after a test is created. To use a different test type, create a new test definition.

Add a test manually

Create tests that the system cannot auto-generate — such as Custom, referential, or business-rule tests:

  1. Click Add.
  2. Select a test type and fill in the required parameters.
  3. Click Save.

See TestGen Test Types for the full list of available test types and their descriptions.

Tip

For Custom and Custom Condition tests, use the Validate button to check your SQL before saving.

Lock and unlock tests

Lock a test to protect its manually tuned parameters from being overwritten when you regenerate tests. Unlocked auto-generated tests are refreshed during regeneration — their parameters may change to reflect current data.

To toggle the lock, select a test definition and change the Locked status.

Note

Manually created tests are never affected by regeneration, so they do not need to be locked.

Activate and deactivate tests

Deactivate a test to exclude it from future test runs without deleting it. This is useful for temporarily disabling tests that produce noisy results while you investigate.

Select one or more tests and toggle the Active status. Only active tests run during test execution.

Copy or move tests

Reuse a tuned test across suites or tables by copying or moving it:

  1. Select one or more test definitions.
  2. Click Copy or Move.
  3. Choose the target test suite and table.

Export test definitions

Click Export to download test definitions to Excel. You can export all definitions, only the definitions matching your current filters, or only selected definitions.

Run tests

Click Run Tests to execute all active tests in the suite directly from this page. For more options including CLI commands and scheduling, see Run Tests.