Data Retention¶

For scalability and data retention considerations, historical records are only kept for a fixed period of time.

Note

Removing records is permanent. If you have more specific needs or questions, do not hesitate to contact your DataKitchen representative.

Events¶

The events received by the Event Ingestion API are maintained by the system for up to one month.

Events with an event_timestamp of more than 30 days are deleted from the system and will no longer appear in the UI.

Runs—the execution of a batch pipeline component—and associated tasks are removed from the system after one month.

As with events, historical runs and tasks will not appear in the UI.

Instances are only kept in the system for one month.

Those with a start_time that occurred more than 30 days ago will not appear in the UI.