Consistency Tests

TestGen consistency tests compare multiple data items to identify alignment, verifying that data does not conflict with itself.

Description and details

Aggregate Balance

Tests for exact match in aggregate measure for each set of column values compared to reference dataset.

This test is not auto-generated. You can create it manually from the Test Definitions page.

Aggregate Balance Percent

Tests that aggregate measure for each set of column values falls within a percent range above or below the measure for reference dataset.

This test is not auto-generated. You can create it manually from the Test Definitions page.

Aggregate Balance Range

Tests that aggregate measure for each set of column values falls within a hard range above or below the measure for reference dataset.

This test is not auto-generated. You can create it manually from the Test Definitions page.

Average Shift

Tests for statistically significant shift in mean value for column from average calculated at baseline.

The system automatically generates this test.

Distribution Shift

Tests the closeness of match between two distributions of aggregate measures across combinations of column values, using Jensen-Shannon Divergence test.

This test is not auto-generated. You can create it manually from the Test Definitions page.

Timeframe Match

Tests for presence of same column values in most recent time window compared to prior time window.

This test is not auto-generated. You can create it manually from the Test Definitions page.

Timeframe No Drops

Tests that column values in most recent time window include at least same as prior time window.

This test is not auto-generated. You can create it manually from the Test Definitions page.