1 March 2023 Release Notes¶
Application version 1.0; User interface version 1.0
Feature highlights¶
Component-level expectations¶
See, in real-time, if the components in your data estate are operating on schedule.
Create expectations for when you know a run should start or end in batch pipelines. With an Expected Schedule defined, Observability can create more realistic instances, provide more accurate results, and keep you informed with alerts for runs that don't meet your expectations.
Better understand the timelines in your data estate—and quickly uncover areas where you can improve. For more information, see Component Expectations.
Journey-level conditions¶
A journey gives you a holistic, end-to-end, cross-tool representation of how a particular data analytic deliverable is created. Now, you can create conditions for every instance—that is, every execution—of your journeys.
Set Instance Conditions to define what qualifies the correct "start" and "end" for an instance. Then, interpret instance results to better understand if work is going as planned.
For complete details, see Instance Conditions.
Instance details¶
In need of more nuanced instance details? Introducing:
- A new Tests tab. Get visibility on tests you're running in your data estate from one simplified page. Instance details now include a tab that aggregates the results of Test Outcome events. Select Tests in the instance details for an at-a-glance test outcomes summary, the status of each test, descriptions and details, metrics, and timestamps.
- A new Status tab. For an end-to-end representation of an instance, select the Status tab in the instance details. Check to see how many runs a component has during an instance, understand which runs are most likely to impact your data estate, and visualize the effect of relationships at-a-glance.
Test outcomes¶
Now results from your Test Outcomes events can be seen across Observability. Get the results of your tests that execute in your external tool from the:
- Run details, where you can drill down into the test outcomes from the run of a specific batch pipeline component.
- Instance details. The Tests tab gives an aggregate view of all the test results received for a particular instance.
- Batch Runs tab of the Events page.
And with rules, Observability can notify you of test outcomes that you need, when you need them.
Learn more in Test with Observability.
New rules¶
You can now define rules:
- Based on Metric Log events. Get notified when a particular metric value event occurs.
- To stay up-to-date with test outcomes. Define a rule to notify you when a test in your data estate has failed, passed, or receives warnings.
- Based on Message Log events. Get notified when a certain type of message is logged (and with a particular severity level).
For more details, see Rules and Rule Patterns and Examples.
Other fixes and enhancements¶
- When you click { } View event data, the Event Metadata dialog now shows all metadata by default. Toggle Display metadata only off for a summarized view.
- We applied general fixes to reduce errors.
- We made various improvements to our user experience. Our help documentation has been updated to reflect these changes.