Skip to content

View Test Results

Users can view test results in several locations throughout Automation. Determine the root cause of an order run failure or analyze performance over time, no matter how you work best:

  • Order run notifications: alerts configured for email recipients are sent at the successful completion of an order run and contain test results.
  • Order run details: this page contains detailed test results for the entire order run, plus results for each node.
  • Variation metrics: this page contains test data compared across multiple order runs for a recipe variation.

Configure notifications

  1. Navigate to the Configure Kitchens page.
    • From the Kitchens page, click Configure Kitchen next to a kitchen name.
    • From the Recipes page, click Configure Kitchen next to the kitchen name in the green navigation bar.
  2. Select the Alerts tab.
  3. Enter recipient addresses and select the Success and Failure event types (at a minimum).
  4. Click Update.

After the next order run in that kitchen completes, the system will send a success or failure alert to the recipients. See Configure Kitchen Alerts for more information.

Access order run details

  1. Select your kitchen.
  2. Select Orders from the green menu.
  3. Click a linked ID in the Order Run column.
  4. On the Order Run Details page:
    • Click Test Results to open the Test Results dialog for the entire recipe.
    • Select a graph node to view the Node Details. Expand the Tests section to view the test results parsed for that node.

For more details on order run test results, see Order Run Test Results.

Note

Test results from the command line: you can also get test results for an order run using DKCloudCommand using the orderrun-info command.

~ $ dk orderun-info --kitchen [KITCHEN] --recipe [RECIPE] --test

View variation metrics

The results from any given test can be compared across multiple order runs for a recipe variation. Charts summarizing these results are available on the Variation Metrics page.

  1. Use one of the following to navigate to the Variation Metrics page:
    • On the Orders page, click a linked recipe/variation name.
    • On the Order Run Details page, click Variation Metrics over Time.
    • From an email, click the linked Order ID.
  2. Select the Tests tab.

See Order Run Test Results: View test results over time for more information.