Manage Table Groups¶
A table group is a selection of database tables within a schema that TestGen profiles and tests. Each table group belongs to a connection and can have its own test suites, monitors, and profiling schedule.
Tip
You can also create a table group as part of the Add Connection wizard, which walks through connection setup and table group creation in one flow.
Prerequisites¶
- A database connection is required. Use an existing connection or create a new one from the Connections page.
- Decide which database schema you want to profile. Take note of the schema name and any specific tables you want to include or exclude.
Create a table group¶
- Select Table Groups from the menu.
- Click Add Table Group.
Fill in the table group details¶
- Give the table group a name, unique within the project.
- In Schema, enter the name of the schema that includes the tables you want to profile.
-
Use the Tables to Include Mask, Tables to Exclude Mask, and Explicit Table List fields to specify which tables within the schema should be profiled.
- Mask fields accept wildcard characters.
- All three fields accept table names.
- Use commas to separate table names in the Explicit Table List field.
- The default include and exclude masks are set to: include everything but do not include temporary tables.
-
Use the Profiling ID column mask and Profiling Surrogate Key column mask fields to specify any ID and surrogate key data present in your tables.
- Optional. Review the Settings. By default, critical data elements (CDEs) are detected during profiling, the table group is included in the Project Dashboard, and a scorecard is added to the Quality Dashboard.
-
Optional. Assign a profiling delay for test generation.
- By default, the delay is 0. That is, any tests generated for a table group use the most recent profiling results.
- Note that tests are expected to pass when generated against the most recent profiling results.
- You can choose to generate tests against profiling results that are
<X>days old.
-
Optional. Toggle on Use profile sampling, then assign a sample percent and minimum count.
- Sampling restricts the system's analysis of the tables included in a table group.
- You can narrow the total scope (sample percent) of the tables to profile and set a lower bound (minimum count).
- For a more accurate representation of your data, run profiling without sampling.
-
Optional. Expand Table Group Tags to add metadata such as a description, data source, business domain, or stakeholder group.
- Click Next.
Verify table access¶
The wizard previews the tables found in the schema. Optionally, click Verify Access to confirm that TestGen can query the tables.
Click Next to continue.
Run profiling¶
- To profile the table group immediately after creation, leave Run profiling toggled on.
- To skip profiling and run it at a later time, toggle off Run profiling. You can run profiling later from the Table Groups page.
Click Next to continue.
Set up testing¶
You can optionally create a test suite and schedule automated test runs as part of the setup.
- To generate tests and schedule test runs, leave Generate and schedule tests toggled on. Enter a Test Suite Name, set a Test Run Schedule, and select a Timezone.
- To skip this step, toggle off Generate and schedule tests. You can create a test suite later from the Test Suites page.
Note
Tests are auto-generated after profiling completes and then run on the schedule you configure. See Recommended frequency for guidance.
Click Next to continue.
Set up monitors¶
You can optionally configure monitors for the table group as part of the setup.
- To configure monitors, leave Configure monitors toggled on. Set the Monitor Run Schedule, Timezone, and optionally adjust the Sensitivity and other prediction model settings.
- To skip this step, toggle off Configure monitors. You can configure monitors later from the Monitors page.
Note
Volume and Schema monitors are created immediately. Freshness monitors are created after the first profiling run completes. See Configure Monitors for details on monitor settings.
Click Save to complete the setup. If profiling is enabled, the button reads Save & Run.
Next steps¶
After the wizard completes, profiling runs in the background (if enabled). Once profiling finishes, tests are auto-generated and monitors begin tracking your tables. Explore results in the Data Catalog.
Edit a table group¶
Select Table Groups from the menu, and click the (edit icon) on the table group you want to modify. Make changes as needed in the dialog, and verify table access before saving.
Delete a table group¶
Warning
Deleting a table group permanently removes all associated profiling runs, test suites, test results, and monitors. This action cannot be undone.
Select Table Groups from the menu, and click the (delete icon) on the table group you want to remove. Confirm the deletion.