TestGen Dataset Components¶
DataKitchen's DataOps Data Quality TestGen is a data quality tool that profiles your databases, generates tests, and verifies the health of your data over time. When you run TestGen tests, send the results to DataOps Observability—so you can monitor outcomes as a holistic part of your data journeys.
Dataset component mapping¶
An Observability dataset component represents a collection of data in your data estate. For example, an Amazon Redshift table or a folder in an Amazon S3 bucket.
Observability automatically associates results sent from TestGen with a dataset component. The following logic applies to the system mapping by default:
- The TestGen table group ID becomes the Observability dataset key.
- The TestGen table group name becomes the Observability dataset name.
Note
Observability creates a new component any time the system receives an event whose <component-type>_key does not match any existing
component keys in the project.
Custom mapping¶
You can choose to override the default mapping at the test suite level by specifying a component key and name for the test suite.
The TestGen documentation includes more information on how this custom mapping can be configured. See Connect TestGen to Observability, for more details.
TestGen datasets in journeys¶
The instance details Tests tab provides an aggregate view of all the test outcomes received for a particular instance, with in-depth TestGen results.
Include TestGen dataset components in your journeys so the data can be captured and displayed as part of an instance.