Skip to content

DataKitchen Documentation

21 August

Initializing search

Home
TestGen
Observability
Automation
Tutorials
Contact Support

DataKitchen Documentation

Home
TestGen
TestGen
- What is TestGen?
- System Architecture and Security
- Get Started
  Get Started
- Connect your Database
  Connect your Database
- Data Profiling
  Data Profiling
- Data Catalog
  Data Catalog
  - Profiling Statistics
- Generate Tests
  Generate Tests
  - Test Definitions
  - Test Types
    
    Test Types
    
    Accuracy Tests
    
    Completeness Tests
    
    Consistency Tests
    
    Timeliness Tests
    
    Uniqueness Tests
    
    Validity Tests
- Data Quality Testing
  Data Quality Testing
  - Run Tests
  - Investigate Test Results
- Monitor Tables
  Monitor Tables
  - Configure Monitors
  - View Monitor Results
- Project Dashboard
- Quality Scores
  Quality Scores
  - Explore and Create Scorecards
  - View Score Details
- Scheduling
- Notifications
- User Access 🛡️
- Manage Projects 🛡️
- Connect to Observability
- Anonymous Analytics
- Administer TestGen
  Administer TestGen
- CLI Reference
  CLI Reference
- Release Notes
  Release Notes
  - Open Source
    Open Source
    
    2026
    2026
    
    24 February
    
    8 January
    
    2025
    2025
    
    16 December
    
    15 December
    
    2 December
    
    13 October
    
    17 September
    
    25 August
    
    13 August
    
    28 July
    
    16 July
    
    24 June
    
    17 June
    
    22 May
    
    21 May
    
    14 May
    
    1 May
    
    2 April
    
    25 March
    
    6 March
    
    28 February
    
    19 February
    
    2024
    2024
    
    3 December
    
    27 November
    
    16 October
    
    14 October
    
    16 August
    
    30 July
    
    16 July
    
    13 June
    
    20 May
    
    16 May
    
    22 April
    
    2023
    2023
    
    21 December
    
    1 December
    
    3 November
    
    30 October
    
    23 October
    
    10 October
    
    25 September
    
    5 September
    
    30 August
    
    25 August
    
    31 July
    
    13 July
    
    Alpha Release
  - Enterprise
    Enterprise
    
    2026
    2026
    
    6 March
    
    24 February
    
    8 January
    
    2025
    2025
    
    16 December
    
    15 December
    
    2 December
    
    10 October
    
    16 September
    
    25 August
    
    12 August
    
    28 July
    
    16 July
    
    24 June
    
    17 June
    
    22 May
    
    21 May
    
    1 May
    
    2 April
    
    24 March
    
    6 March
    
    28 February
    
    19 February
    
    2024
    2024
    
    25 November
    
    20 November
    
    16 October
    
    3 October
    
    1 October
    
    26 September
    
    16 August
    
    25 July
    
    10 May
    
    6 February
    
    25 January
Observability
Observability
- What is Observability?
- Get Started
  Get Started
- Core Concepts
  Core Concepts
- Integration Agents
  Integration Agents
  - Deploy an Agent
    
    Deploy an Agent
    
    Airflow
    
    Amazon S3
    
    AutoSys 🛡️
    
    Azure Blob Storage
    
    Azure Data Factory
    
    Azure Functions
    
    Azure Synapse
    
    Databricks
    
    dbt Core
    
    Fivetran Log Connector
    
    Google Cloud Composer
    
    Microsoft Power BI
    
    Microsoft SSIS
    
    Qlik
    
    Talend
  - Update or Remove an Agent
  - Azure Configurations
    Azure Configurations
    
    Create an Azure Service Principal
    
    Add Azure Diagnostic Settings
- Event Ingestion API
  Event Ingestion API
  - Event Ingestion API Identifiers
  - Event Endpoint Details
  - Publish Events to the API
    
    Publish Events to the API
    
    Publish Events via Client SDK
    
    Publish Events Directly
- Projects 🛡️
  Projects 🛡️
- Journeys
  Journeys
  - Create Journeys
  - View Journey Details
  - Create Relationships
  - Manage Journey Settings
  - Configure Instance Conditions
    
    Configure Instance Conditions
    
    Batch Instance Conditions
    
    Schedule Instance Conditions
    
    Default Instance Conditions
    
    Payload Instance Conditions
  - Delete Journeys
- Rules
  Rules
  - Define Rules
  - Rule Triggers
  - Web Request
    
    Web Request
    
    JSON Data Points
  - Rule Patterns and Examples
  - Web Request Walkthroughs
    
    Web Request Walkthroughs
    
    Slack
    
    Jira
    
    Teams
- Instances
  Instances
  - Define Instances
  - Payload Instances
  - View Instance Details
    
    View Instance Details
    
    Status Tab
    
    Timeline Tab
    
    Batch Runs Tab
    
    Tests Tab
    
    TestGen Results
    
    Events Tab
  - Upcoming Instances
  - Instance Status
  - Complex Instance Example
- Components
  Components
  - Create Components
  - Manage Components
  - Configure Component Expectations
    
    Configure Component Expectations
    
    Expected Schedule
    
    Arrival Window
    
    Cron Expressions
  - Delete Components
  - Component Bulk Actions
  - Batch Pipeline
    
    Batch Pipeline
    
    Tasks
    
    Runs
    
    View Run Details
    
    Run Status
  - Dataset
    
    Dataset
    
    TestGen Dataset Components
  - Server
  - Streaming Pipeline
- Events
  Events
  - Event Types
  - View Events and Runs
    
    View Events and Runs
    
    All Events Tab
    
    Batch Runs Tab
  - Event Processing
- Integrations
  Integrations
  - Available Agents
  - Heartbeat Signal
- API Keys
  API Keys
  - Observability API
  - Delete an API Key
- Project Settings
- Data Retention
- Anonymous Analytics
- Troubleshooting
  Troubleshooting
- Administer Observability
  Administer Observability
- Release Notes
  Release Notes
  - Open Source
    Open Source
    
    2026
    2026
    
    11 March
    
    2025
    2025
    
    5 November
    
    25 August
    
    28 July
    
    11 April
    
    6 March
    
    27 February
    
    2024
    2024
    
    20 November
    
    21 August
    
    20 August
    
    21 May
    
    13 May
    
    22 April
    
    2023
    2023
    
    26 December
    
    6 December
    
    27 November
    
    14 November
    
    8 November
    
    25 October
    
    10 October
    
    9 October
    
    26 September
    
    18 September
    
    7 September
    
    30 August
    
    28 August
    
    21 August
    
    31 July
    
    17 July
    
    27 June
    
    12 June
    
    5 June
    
    25 May
    
    23 May
    
    18 May
    
    8 May
    
    4 May
    
    1 May
    
    18 April
    
    3 April
    
    27 March
    
    7 March
    
    1 March
    
    23 February
    
    1 February
    
    18 January
    
    2022
    2022
    
    15 December
    
    16 November
    
    19 October
    
    Alpha Release Breaking Changes
    
    Deprecation Notes
    
    Alpha Release
  - Enterprise
    Enterprise
    
    2026
    2026
    
    10 March
    
    2025
    2025
    
    5 November
    
    25 August
    
    28 July
    
    30 April
    
    22 April
    
    17 April
    
    25 March
    
    12 March
    
    4 March
    
    14 February
    
    2024
    2024
    
    22 November
    
    20 November
    
    26 August
    
    12 August
    
    13 July
    
    3 April
    
    26 March
    
    20 March
    
    12 March
    
    19 February
    
    13 February
    
    10 January
  - Agent Changelog
Automation
Automation
- What is Automation?
- Architecture & Concepts
  Architecture & Concepts
- Kitchens
  Kitchens
  - Kitchens Page
  - Kitchen Users
  - Kitchen Security
    
    Kitchen Security
    
    Manage Access
    
    Kitchen Roles
    
    Set Kitchen Type
  - Create Kitchens
  - Configure Kitchens
  - Kitchen History
  - Merge Kitchens
  - Revert Kitchens
    
    Revert Kitchens
    
    Revert Process
  - Delete Kitchens
- Agents
  Agents
  - Agent Resources
  - Specify Agent Groups
- Vaults and Secrets
  Vaults and Secrets
  - Global Vault
    
    Global Vault
    
    Configure Global Vault
  - Kitchen Vault
    
    Kitchen Vault
    
    Configure Kitchen Vaults
    
    Set Vault Inheritance
  - Custom Vaults
    
    Custom Vaults
    
    Configure Custom Vault
  - Secrets
    
    Secrets
    
    Create and Edit Secrets
    
    Delete Secrets
    
    Secrets Usage
    
    Insert Secrets in Recipes
    
    Secrets at Runtime
    
    Security Considerations
- Recipes
  Recipes
- Recipe Nodes
  Recipe Nodes
  - Node Components
  - Rename Nodes
  - Compile Node Files
  - Synchronize Nodes
  - Action Nodes
    
    Action Nodes
    
    Create an Action Node
    
    Configure Action Nodes
    
    Copy and Compute Data Example
    
    Cleanse and Test Raw Data
  - Conditional Nodes
    
    Conditional Nodes
    
    Create a Conditional Node
    
    Edit a Conditional Node
    
    Conditional Node Processing
    
    Processing a Subset Example
    
    Check User Status Example
    
    Process on True Example
    
    Multiple Results Example
  - Container Nodes
    
    Container Nodes
    
    Container Images
    
    Container Node File Structure
    
    Create a Container Node
    
    Configure Container Nodes
    
    Container Notebook Properties
    
    Manage Container Icons
    
    Container Node Tests
    
    Container Node Examples
  - General Purpose Container
    
    General Purpose Container
    
    GPC Pre-Installed Packages
    
    GPC File Structure and Configuration
    
    GPC File Structure and Configuration
    
    GPC description.json
    
    GPC docker-share Directory
    
    GPC notebook.json
    
    Vault Secrets in the GPC
    
    Shell Script Exports
    
    GPC Logging
    
    GPC Resource Allocation
    
    GPC Best Practices
    
    GPC Basic Example
    
    Source-Sink Example
    
    Python Dependency Example
    
    Shared Resources Example
  - DataMapper Nodes
    
    DataMapper Nodes
    
    Create a DataMapper Node
    
    Configure DataMapper Nodes
    
    DataMapper Node Properties
    
    DataMapper Node Files
    
    Mapping with Variables Example
    
    Mapping File to Database Example
    
    Wildcard Mapping Example
  - Ingredient Nodes
    
    Ingredient Nodes
    
    Create an Ingredient Node
    
    Configure Ingredient Nodes
    
    Start/Stop a Cloud Resource
    
    Email Approval Utility
    
    Simplify a Variation Graph
    
    Get Database Values for Testing
- Ingredients
  Ingredients
- Recipe Variables
  Recipe Variables
- Data Sources and Data Sinks
  Data Sources and Data Sinks
  - Source and Sink Processing
  - Properties and Variables
    
    Properties and Variables
    
    Connection Properties
    
    Built-In Runtime Variables
    
    File-Based Properties
    
    File-Based Variables
    
    File-Based Wildcards
    
    Database Properties
    
    Database Variables
    
    System Connector Properties
  - Supported Connectors
    
    Supported Connectors
    
    Amazon Redshift/PostgreSQL
    
    Amazon S3
    
    Azure Blob Storage
    
    Azure Data Lake Storage Gen2
    
    DB2
    
    Dictionary
    
    Dictionary
    
    Dictionary Setup Examples
    
    FTP
    
    Google BigQuery
    
    Google Cloud Storage
    
    Microsoft SQL Server/Azure Synapse
    
    MySQL
    
    Oracle
    
    Salesforce
    
    SFTP
    
    Snowflake
    
    Teradata
  - File Settings for SQL Connectors
  - Data Source SQL Fields
  - Tips on Key Generation
  - Sources and Sinks in Container Nodes
- Tests
  Tests
- Orders
  Orders
  - Run an Order
    
    Run an Order
    
    Order-Time Overrides
    
    Run One Node
    
    Resume Order Runs
    
    Order Run Execution
  - Order Runs
    
    Order Runs
    
    Order Run Details
    
    Order Run Logs
    
    Order Run Test Results
    
    Order Run Timings
  - File Evaluation Sequence
  - Runtime Resources
- Schedules
  Schedules
- Alerts
  Alerts
- Reports
- CLI
  CLI
  - Install and Upgrade DKCloudCommand
  - Set Up Merge and Diff Tool
  - Configure DKCloudCommand
  - Manage User Contexts
  - Set Up Local Workspace
  - Kitchen Settings
  - Command and Option References
    
    Command and Option References
    
    Commands Reference
    
    Options Reference
  - DKCloudCommand Walkthroughs
    
    DKCloudCommand Walkthroughs
    
    Useful DKCloudCommand Techniques
    
    Common DKCloudCommand Sequences
    
    active-serving-watcher
    
    config
    
    config-list
    
    context-delete
    
    context-list
    
    context-switch
    
    file-compile
    
    file-delete
    
    file-diff
    
    file-get
    
    file-history
    
    file-merge
    
    file-resolve
    
    file-update
    
    git-setup
    
    kitchen-config
    
    kitchen-create
    
    kitchen-delete
    
    kitchen-get
    
    kitchen-history
    
    kitchen-list
    
    kitchen-merge
    
    kitchen-merge-preview
    
    kitchen-revert
    
    kitchen-settings-get
    
    kitchen-settings-update
    
    kitchen-which
    
    order-delete
    
    order-list
    
    order-run
    
    order-stop
    
    orderrun-delete
    
    orderrun-info
    
    orderrun-resume
    
    orderrun-stop
    
    recipe-compile
    
    recipe-copy
    
    recipe-create
    
    recipe-delete
    
    recipe-get
    
    recipe-ingredient-list
    
    recipe-list
    
    recipe-status
    
    recipe-update
    
    recipe-validate
    
    recipe-variation-list
    
    secret-delete
    
    secret-exists
    
    secret-list
    
    secret-write
    
    user-info
    
    vault-config
    
    vault-delete
    
    vault-info
- API
  API
- Troubleshooting
  Troubleshooting
  - 504 Errors
  - Order Problems
    
    Order Problems
    
    File Not Found
    
    Insufficient Resources
    
    Parameter Configuration Problem
    
    Vault Entry Problem
  - Pinned Package Dependencies
  - Resolve DKCloudCommand SSL Errors
  - Troubleshoot CLI Issues
    
    Troubleshoot CLI Issues
    
    Cannot Save to Disk
    
    Python Package Conflict
    
    Unknown Error in Command Runs
  - Run kitchen-merge-preview Again
- Release Notes
  Release Notes
  - 2026
    2026
    
    7 March
  - 2025
    2025
    
    27 September
    
    30 August
    
    23 April
    
    9 April
    
    6 March
    
    7 February
  - 2024
    2024
    
    22 February
    
    31 January
    
    17 January
  - 2023
    2023
    
    28 December
    
    28 September
    
    13 September
    
    August Changelog
    
    10 July
    
    19 June
    
    17 April
    
    27 March
    
    14 February
    
    DKCloudCommand Breaking Change
    
    31 January
    
    24 January
    
    18 January
  - 2022
    2022
    
    28 December
    
    22 December
    
    15 December Library Upgrades
    
    1 December
    
    9 November
    
    20 June
    
    16 May
    
    12 April
    
    29 March
    
    8 March
    
    1 March
    
    22 February
    
    23 January
    
    11 January
  - 2021
    2021
    
    22 November
    
    7 November
    
    31 October
    
    24 October
    
    3 October
    
    26 September
    
    12 September
    
    29 August
    
    9 August
    
    25 July
    
    6 July
    
    27 June
    
    7 June
    
    24 May
    
    17 May
    
    3 May
    
    26 April
    
    19 April
    
    12 April
    
    5 April
    
    29 March
    
    22 March
    
    15 March
    
    8 March
    
    1 March
    
    15 February
    
    8 February
    
    1 February
    
    25 January
    
    18 January
    
    11 January
  - 2020
    2020
    
    21 December
    
    14 December
    
    7 December
    
    16 November
    
    9 November
    
    2 November
    
    19 October
    
    12 October
    
    5 October
    
    28 September
    
    21 September
    
    14 September
    
    8 September
    
    17 August
    
    10 August
    
    27 July
    
    20 July
    
    13 July
    
    6 July
    
    29 June
    
    22 June
    
    15 June
    
    8 June
    
    1 June
    
    26 May
    
    18 May
    
    11 May
    
    4 May
    
    27 April
    
    20 April
    
    6 April
  - GPC Image Changelog
  - Kubernetes Cluster Changelog
Tutorials
Tutorials
- Data Observability Quickstart Demo
  Data Observability Quickstart Demo
- Data Quality Quickstart Demos
  Data Quality Quickstart Demos
- DataOps Concepts
  DataOps Concepts
Contact Support

Home
Observability
Release Notes
Open Source
2024

21 August 2024 Release Notes¶

Open Source Version 2.2.1

We fixed a bug in the agent deploy script generated through the integration guides. [#14]

Made with Material for MkDocs