Skip to content

Configure an Arrival Window

You can set a frequency and window of time that you expect write Dataset Operation events to occur for dataset components.

Observability can then generate alerts to report whether these expectations are met—or not—so you know when to take action in your data estate.

Expected behaviors

Dataset expectations are evaluated against a write Dataset Operation event during a specified window of time.

Note

A Dataset Operation event can represent a read or write action. Write represents an asset writing to a dataset component in your data estate. See Event Types for more information.

  1. On the day and/or time set in the Frequency field, the system expects to receive a write Dataset Operation event at any point during the window of time set by the Duration field.

  2. After this window has passed, the system checks if the event has occurred.

    • If the event has occurred, the system returns to step 1.
    • If the event has not occurred, then the system continues with step 3.

  3. The system updates each journey that includes the component, then returns to step 1.

    • If there is an active instance for a journey, the system generates an alert ("Dataset asset did not arrive") for that instance.
    • If there is no active instance for a journey the system creates a new instance and includes an alert.

How to set an arrival window

The following describes how to make changes to a single component. To update multiple components at once, see Bulk Component Actions.

Tip

Use Custom cron expressions in your expectations. See Cron Expressions in Observability for what's supported.

  1. Use one of the following to navigate to the component details:
    • Select Components from the menu, then select a dataset.
    • Select Journeys from the menu, then select a journey that includes a dataset. From the Relationships tab, click .
  2. Click Edit.

  3. Under Expected Arrival Window, set a frequency.

    1. Click in the Frequency field.
    2. Select the timeframe: Every x hours, Every x days, On certain days, or Custom.
    3. Complete the frequency details.
    4. Assign a timezone.
    5. Verify that the Next Time calculated by the system aligns with your expectations. Make adjustments as needed.
    6. Click Apply.

  4. Set a Duration.

    1. Click in the first field.
    2. Enter a whole number to represent the window of time.
    3. Use the drop-down to set the unit: minutes, hours, or days.

  5. Click Save.

At any point, click Cancel to end without saving.