Skip to content

DataKitchen Documentation

21 May

Initializing search

Home
TestGen
Observability
Automation
Tutorials
Contact Support

DataKitchen Documentation

Home
TestGen
TestGen
- What is TestGen?
- System Architecture and Security
- Get Started
  Get Started
- Connect your Database
  Connect your Database
- Data Profiling
  Data Profiling
- Data Catalog
  Data Catalog
  - Profiling Statistics
- Generate Tests
  Generate Tests
  - Test Definitions
  - Test Types
    
    Test Types
    
    Accuracy Tests
    
    Completeness Tests
    
    Consistency Tests
    
    Timeliness Tests
    
    Uniqueness Tests
    
    Validity Tests
- Data Quality Testing
  Data Quality Testing
  - Run Tests
  - Investigate Test Results
- Monitor Tables
  Monitor Tables
  - Configure Monitors
  - View Monitor Results
- Project Dashboard
- Quality Scores
  Quality Scores
  - Explore and Create Scorecards
  - View Score Details
- Scheduling
- Notifications
- User Access 🛡️
- Manage Projects 🛡️
- Connect to Observability
- Anonymous Analytics
- Administer TestGen
  Administer TestGen
- CLI Reference
  CLI Reference
- Release Notes
  Release Notes
  - Open Source
    Open Source
    
    2026
    2026
    
    24 February
    
    8 January
    
    2025
    2025
    
    16 December
    
    15 December
    
    2 December
    
    13 October
    
    17 September
    
    25 August
    
    13 August
    
    28 July
    
    16 July
    
    24 June
    
    17 June
    
    22 May
    
    21 May
    
    14 May
    
    1 May
    
    2 April
    
    25 March
    
    6 March
    
    28 February
    
    19 February
    
    2024
    2024
    
    3 December
    
    27 November
    
    16 October
    
    14 October
    
    16 August
    
    30 July
    
    16 July
    
    13 June
    
    20 May
    
    16 May
    
    22 April
    
    2023
    2023
    
    21 December
    
    1 December
    
    3 November
    
    30 October
    
    23 October
    
    10 October
    
    25 September
    
    5 September
    
    30 August
    
    25 August
    
    31 July
    
    13 July
    
    Alpha Release
  - Enterprise
    Enterprise
    
    2026
    2026
    
    6 March
    
    24 February
    
    8 January
    
    2025
    2025
    
    16 December
    
    15 December
    
    2 December
    
    10 October
    
    16 September
    
    25 August
    
    12 August
    
    28 July
    
    16 July
    
    24 June
    
    17 June
    
    22 May
    
    21 May
    
    1 May
    
    2 April
    
    24 March
    
    6 March
    
    28 February
    
    19 February
    
    2024
    2024
    
    25 November
    
    20 November
    
    16 October
    
    3 October
    
    1 October
    
    26 September
    
    16 August
    
    25 July
    
    10 May
    
    6 February
    
    25 January
Observability
Observability
- What is Observability?
- Get Started
  Get Started
- Core Concepts
  Core Concepts
- Integration Agents
  Integration Agents
  - Deploy an Agent
    
    Deploy an Agent
    
    Airflow
    
    Amazon S3
    
    AutoSys 🛡️
    
    Azure Blob Storage
    
    Azure Data Factory
    
    Azure Functions
    
    Azure Synapse
    
    Databricks
    
    dbt Core
    
    Fivetran Log Connector
    
    Google Cloud Composer
    
    Microsoft Power BI
    
    Microsoft SSIS
    
    Qlik
    
    Talend
  - Update or Remove an Agent
  - Azure Configurations
    Azure Configurations
    
    Create an Azure Service Principal
    
    Add Azure Diagnostic Settings
- Event Ingestion API
  Event Ingestion API
  - Event Ingestion API Identifiers
  - Event Endpoint Details
  - Publish Events to the API
    
    Publish Events to the API
    
    Publish Events via Client SDK
    
    Publish Events Directly
- Projects 🛡️
  Projects 🛡️
- Journeys
  Journeys
  - Create Journeys
  - View Journey Details
  - Create Relationships
  - Manage Journey Settings
  - Configure Instance Conditions
    
    Configure Instance Conditions
    
    Batch Instance Conditions
    
    Schedule Instance Conditions
    
    Default Instance Conditions
    
    Payload Instance Conditions
  - Delete Journeys
- Rules
  Rules
  - Define Rules
  - Rule Triggers
  - Web Request
    
    Web Request
    
    JSON Data Points
  - Rule Patterns and Examples
  - Web Request Walkthroughs
    
    Web Request Walkthroughs
    
    Slack
    
    Jira
    
    Teams
- Instances
  Instances
  - Define Instances
  - Payload Instances
  - View Instance Details
    
    View Instance Details
    
    Status Tab
    
    Timeline Tab
    
    Batch Runs Tab
    
    Tests Tab
    
    TestGen Results
    
    Events Tab
  - Upcoming Instances
  - Instance Status
  - Complex Instance Example
- Components
  Components
  - Create Components
  - Manage Components
  - Configure Component Expectations
    
    Configure Component Expectations
    
    Expected Schedule
    
    Arrival Window
    
    Cron Expressions
  - Delete Components
  - Component Bulk Actions
  - Batch Pipeline
    
    Batch Pipeline
    
    Tasks
    
    Runs
    
    View Run Details
    
    Run Status
  - Dataset
    
    Dataset
    
    TestGen Dataset Components
  - Server
  - Streaming Pipeline
- Events
  Events
  - Event Types
  - View Events and Runs
    
    View Events and Runs
    
    All Events Tab
    
    Batch Runs Tab
  - Event Processing
- Integrations
  Integrations
  - Available Agents
  - Heartbeat Signal
- API Keys
  API Keys
  - Observability API
  - Delete an API Key
- Project Settings
- Data Retention
- Anonymous Analytics
- Troubleshooting
  Troubleshooting
- Administer Observability
  Administer Observability
- Release Notes
  Release Notes
  - Open Source
    Open Source
    
    2026
    2026
    
    11 March
    
    2025
    2025
    
    5 November
    
    25 August
    
    28 July
    
    11 April
    
    6 March
    
    27 February
    
    2024
    2024
    
    20 November
    
    21 August
    
    20 August
    
    21 May
    
    13 May
    
    22 April
    
    2023
    2023
    
    26 December
    
    6 December
    
    27 November
    
    14 November
    
    8 November
    
    25 October
    
    10 October
    
    9 October
    
    26 September
    
    18 September
    
    7 September
    
    30 August
    
    28 August
    
    21 August
    
    31 July
    
    17 July
    
    27 June
    
    12 June
    
    5 June
    
    25 May
    
    23 May
    
    18 May
    
    8 May
    
    4 May
    
    1 May
    
    18 April
    
    3 April
    
    27 March
    
    7 March
    
    1 March
    
    23 February
    
    1 February
    
    18 January
    
    2022
    2022
    
    15 December
    
    16 November
    
    19 October
    
    Alpha Release Breaking Changes
    
    Deprecation Notes
    
    Alpha Release
  - Enterprise
    Enterprise
    
    2026
    2026
    
    10 March
    
    2025
    2025
    
    5 November
    
    25 August
    
    28 July
    
    30 April
    
    22 April
    
    17 April
    
    25 March
    
    12 March
    
    4 March
    
    14 February
    
    2024
    2024
    
    22 November
    
    20 November
    
    26 August
    
    12 August
    
    13 July
    
    3 April
    
    26 March
    
    20 March
    
    12 March
    
    19 February
    
    13 February
    
    10 January
  - Agent Changelog
Automation
Automation
- What is Automation?
- Architecture & Concepts
  Architecture & Concepts
- Kitchens
  Kitchens
  - Kitchens Page
  - Kitchen Users
  - Kitchen Security
    
    Kitchen Security
    
    Manage Access
    
    Kitchen Roles
    
    Set Kitchen Type
  - Create Kitchens
  - Configure Kitchens
  - Kitchen History
  - Merge Kitchens
  - Revert Kitchens
    
    Revert Kitchens
    
    Revert Process
  - Delete Kitchens
- Agents
  Agents
  - Agent Resources
  - Specify Agent Groups
- Vaults and Secrets
  Vaults and Secrets
  - Global Vault
    
    Global Vault
    
    Configure Global Vault
  - Kitchen Vault
    
    Kitchen Vault
    
    Configure Kitchen Vaults
    
    Set Vault Inheritance
  - Custom Vaults
    
    Custom Vaults
    
    Configure Custom Vault
  - Secrets
    
    Secrets
    
    Create and Edit Secrets
    
    Delete Secrets
    
    Secrets Usage
    
    Insert Secrets in Recipes
    
    Secrets at Runtime
    
    Security Considerations
- Recipes
  Recipes
- Recipe Nodes
  Recipe Nodes
  - Node Components
  - Rename Nodes
  - Compile Node Files
  - Synchronize Nodes
  - Action Nodes
    
    Action Nodes
    
    Create an Action Node
    
    Configure Action Nodes
    
    Copy and Compute Data Example
    
    Cleanse and Test Raw Data
  - Conditional Nodes
    
    Conditional Nodes
    
    Create a Conditional Node
    
    Edit a Conditional Node
    
    Conditional Node Processing
    
    Processing a Subset Example
    
    Check User Status Example
    
    Process on True Example
    
    Multiple Results Example
  - Container Nodes
    
    Container Nodes
    
    Container Images
    
    Container Node File Structure
    
    Create a Container Node
    
    Configure Container Nodes
    
    Container Notebook Properties
    
    Manage Container Icons
    
    Container Node Tests
    
    Container Node Examples
  - General Purpose Container
    
    General Purpose Container
    
    GPC Pre-Installed Packages
    
    GPC File Structure and Configuration
    
    GPC File Structure and Configuration
    
    GPC description.json
    
    GPC docker-share Directory
    
    GPC notebook.json
    
    Vault Secrets in the GPC
    
    Shell Script Exports
    
    GPC Logging
    
    GPC Resource Allocation
    
    GPC Best Practices
    
    GPC Basic Example
    
    Source-Sink Example
    
    Python Dependency Example
    
    Shared Resources Example
  - DataMapper Nodes
    
    DataMapper Nodes
    
    Create a DataMapper Node
    
    Configure DataMapper Nodes
    
    DataMapper Node Properties
    
    DataMapper Node Files
    
    Mapping with Variables Example
    
    Mapping File to Database Example
    
    Wildcard Mapping Example
  - Ingredient Nodes
    
    Ingredient Nodes
    
    Create an Ingredient Node
    
    Configure Ingredient Nodes
    
    Start/Stop a Cloud Resource
    
    Email Approval Utility
    
    Simplify a Variation Graph
    
    Get Database Values for Testing
- Ingredients
  Ingredients
- Recipe Variables
  Recipe Variables
- Data Sources and Data Sinks
  Data Sources and Data Sinks
  - Source and Sink Processing
  - Properties and Variables
    
    Properties and Variables
    
    Connection Properties
    
    Built-In Runtime Variables
    
    File-Based Properties
    
    File-Based Variables
    
    File-Based Wildcards
    
    Database Properties
    
    Database Variables
    
    System Connector Properties
  - Supported Connectors
    
    Supported Connectors
    
    Amazon Redshift/PostgreSQL
    
    Amazon S3
    
    Azure Blob Storage
    
    Azure Data Lake Storage Gen2
    
    DB2
    
    Dictionary
    
    Dictionary
    
    Dictionary Setup Examples
    
    FTP
    
    Google BigQuery
    
    Google Cloud Storage
    
    Microsoft SQL Server/Azure Synapse
    
    MySQL
    
    Oracle
    
    Salesforce
    
    SFTP
    
    Snowflake
    
    Teradata
  - File Settings for SQL Connectors
  - Data Source SQL Fields
  - Tips on Key Generation
  - Sources and Sinks in Container Nodes
- Tests
  Tests
- Orders
  Orders
  - Run an Order
    
    Run an Order
    
    Order-Time Overrides
    
    Run One Node
    
    Resume Order Runs
    
    Order Run Execution
  - Order Runs
    
    Order Runs
    
    Order Run Details
    
    Order Run Logs
    
    Order Run Test Results
    
    Order Run Timings
  - File Evaluation Sequence
  - Runtime Resources
- Schedules
  Schedules
- Alerts
  Alerts
- Reports
- CLI
  CLI
  - Install and Upgrade DKCloudCommand
  - Set Up Merge and Diff Tool
  - Configure DKCloudCommand
  - Manage User Contexts
  - Set Up Local Workspace
  - Kitchen Settings
  - Command and Option References
    
    Command and Option References
    
    Commands Reference
    
    Options Reference
  - DKCloudCommand Walkthroughs
    
    DKCloudCommand Walkthroughs
    
    Useful DKCloudCommand Techniques
    
    Common DKCloudCommand Sequences
    
    active-serving-watcher
    
    config
    
    config-list
    
    context-delete
    
    context-list
    
    context-switch
    
    file-compile
    
    file-delete
    
    file-diff
    
    file-get
    
    file-history
    
    file-merge
    
    file-resolve
    
    file-update
    
    git-setup
    
    kitchen-config
    
    kitchen-create
    
    kitchen-delete
    
    kitchen-get
    
    kitchen-history
    
    kitchen-list
    
    kitchen-merge
    
    kitchen-merge-preview
    
    kitchen-revert
    
    kitchen-settings-get
    
    kitchen-settings-update
    
    kitchen-which
    
    order-delete
    
    order-list
    
    order-run
    
    order-stop
    
    orderrun-delete
    
    orderrun-info
    
    orderrun-resume
    
    orderrun-stop
    
    recipe-compile
    
    recipe-copy
    
    recipe-create
    
    recipe-delete
    
    recipe-get
    
    recipe-ingredient-list
    
    recipe-list
    
    recipe-status
    
    recipe-update
    
    recipe-validate
    
    recipe-variation-list
    
    secret-delete
    
    secret-exists
    
    secret-list
    
    secret-write
    
    user-info
    
    vault-config
    
    vault-delete
    
    vault-info
- API
  API
- Troubleshooting
  Troubleshooting
  - 504 Errors
  - Order Problems
    
    Order Problems
    
    File Not Found
    
    Insufficient Resources
    
    Parameter Configuration Problem
    
    Vault Entry Problem
  - Pinned Package Dependencies
  - Resolve DKCloudCommand SSL Errors
  - Troubleshoot CLI Issues
    
    Troubleshoot CLI Issues
    
    Cannot Save to Disk
    
    Python Package Conflict
    
    Unknown Error in Command Runs
  - Run kitchen-merge-preview Again
- Release Notes
  Release Notes
  - 2026
    2026
    
    7 March
  - 2025
    2025
    
    27 September
    
    30 August
    
    23 April
    
    9 April
    
    6 March
    
    7 February
  - 2024
    2024
    
    22 February
    
    31 January
    
    17 January
  - 2023
    2023
    
    28 December
    
    28 September
    
    13 September
    
    August Changelog
    
    10 July
    
    19 June
    
    17 April
    
    27 March
    
    14 February
    
    DKCloudCommand Breaking Change
    
    31 January
    
    24 January
    
    18 January
  - 2022
    2022
    
    28 December
    
    22 December
    
    15 December Library Upgrades
    
    1 December
    
    9 November
    
    20 June
    
    16 May
    
    12 April
    
    29 March
    
    8 March
    
    1 March
    
    22 February
    
    23 January
    
    11 January
  - 2021
    2021
    
    22 November
    
    7 November
    
    31 October
    
    24 October
    
    3 October
    
    26 September
    
    12 September
    
    29 August
    
    9 August
    
    25 July
    
    6 July
    
    27 June
    
    7 June
    
    24 May
    
    17 May
    
    3 May
    
    26 April
    
    19 April
    
    12 April
    
    5 April
    
    29 March
    
    22 March
    
    15 March
    
    8 March
    
    1 March
    
    15 February
    
    8 February
    
    1 February
    
    25 January
    
    18 January
    
    11 January
  - 2020
    2020
    
    21 December
    
    14 December
    
    7 December
    
    16 November
    
    9 November
    
    2 November
    
    19 October
    
    12 October
    
    5 October
    
    28 September
    
    21 September
    
    14 September
    
    8 September
    
    17 August
    
    10 August
    
    27 July
    
    20 July
    
    13 July
    
    6 July
    
    29 June
    
    22 June
    
    15 June
    
    8 June
    
    1 June
    
    26 May
    
    18 May
    
    11 May
    
    4 May
    
    27 April
    
    20 April
    
    6 April
  - GPC Image Changelog
  - Kubernetes Cluster Changelog
Tutorials
Tutorials
- Data Observability Quickstart Demo
  Data Observability Quickstart Demo
- Data Quality Quickstart Demos
  Data Quality Quickstart Demos
- DataOps Concepts
  DataOps Concepts
Contact Support

Home
Observability
Release Notes
Open Source
2024

21 May 2024 Release Notes¶

Open Source Version 2.0.3

We fixed an issue with the display of start times on the Batch Runs tabs. [#12]

Made with Material for MkDocs