Skip to content

Test Definitions

View and manage the individual tests in a test suite — review auto-generated tests, tune parameters, add manual tests, and control which tests run during execution.

Test definitions sit between test generation (which auto-creates definitions from profiling results) and test execution (which runs them against your data). This is where you fine-tune what gets tested and how.

Prerequisites

A test suite with generated or manually created tests. To populate a test suite automatically, see Generate Tests.

  1. Select Test Suites from the menu.
  2. On a test suite, click View N test definitions to open the list of test definitions for that suite.

Review and filter tests

The test definitions grid displays all tests in the suite. Each row shows the test's table, column or focus area, test type, and status flags such as Active, Locked, and Flagged.

Use the filters at the top of the grid to narrow the list by Table, Column, Test Type, or Flagged status. Click any row to view the full test definition details in the bottom panel.

Edit a test definition

To adjust thresholds, expected values, or other parameters after reviewing test results:

  1. Select the test definition to open the detail panel.
  2. Click Edit.
  3. Modify the parameters as needed.
  4. Click Save.

Note

The test type, schema, and test suite cannot be changed after a test is created. To use a different test type, create a new test definition.

Add a test manually

Create tests that the system cannot auto-generate — such as Custom, referential, or business-rule tests:

  1. Click Add.
  2. Select a test type and fill in the required parameters.
  3. Click Save.

See TestGen Test Types for the full list of available test types and their descriptions.

Tip

To add a Custom Condition, SQL Metric, or Custom Test, see Add Custom SQL Tests.

Lock and unlock tests

Lock a test to protect its manually tuned parameters from being overwritten when you regenerate tests. Unlocked auto-generated tests are refreshed during regeneration — their parameters may change to reflect current data.

Select one or more tests and change the Locked status using the (lock icon) and (unlock icon).

Note

Manually created tests are never affected by regeneration, so they do not need to be locked.

Activate and deactivate tests

Deactivate a test to exclude it from future test runs without deleting it. This is useful for temporarily disabling tests that produce noisy results while you investigate.

Select one or more tests and toggle the Active status using the (activate icon) and (deactivate icon). Only active tests run during test execution.

Copy or move tests

Reuse a tuned test across suites or tables by copying or moving it:

  1. Select one or more test definitions.
  2. Click the (copy/move icon).
  3. Choose the target test suite and table.
  4. Click Copy or Move.

Flag tests for review

You can flag test definitions to mark them for attention using the (flag icon) and (clear flag icon). Flagged tests can be filtered using the Flagged dropdown on both the Test Definitions and Test Results pages. See Investigate Test Results for details.

Add notes to a test

You can add timestamped notes to any test definition to document investigation context, decisions, or open questions. Select a test definition to open the detail panel, and click Notes to view or add notes. See Investigate Test Results for details.

Export test definitions

Click Export to download test definitions.

  • Under Excel, export all definitions, only the definitions matching your current filters, or only selected definitions, for review.
  • Under JSON, select Test definitions to download every definition in the suite as a file you can edit and import into this test suite or another one.

Import test definitions

Import a JSON file of test definitions to update tests in bulk, copy tests from another test suite, or transfer tests to another table group, as in Verify a Data Migration.

  1. Click Import.
  2. Upload the test definitions JSON file.
  3. Choose what happens to Tests in the file with no match, Tests in the file that match, and Tests not in the file.
  4. Review the preview of what will be created, updated, skipped, and deleted. If tests will be deleted, confirm the deletion. Click Import Tests.

Only the fields present in the file are written. A matching test keeps its values for any field the file leaves out.

An auto-generated test matches a test of the same type on the same table and column. A manual test matches by its external_id. Import skips a test whose table TestGen has not found in the test suite's table group, and a column-scoped test whose column TestGen has not found in that table.

Tip

You can also export and import test definitions through the REST API. See Import and Export Tests for details.

Run tests

Click Run Tests to execute all active tests in the suite directly from this page. For more options including scheduling, see Run Tests.