Report Library

The Report Library presents a detailed overview of the tests run within a selected period of time, including:

  • Statistical information for all listed tests
  • Historical breakdown of when tests failed
  • Table of all selected tests, including information on the parameters of the test run

For information on how to filter and group the view, see Focus on what's important to you.

This figure shows the Report Library grouped by device model.

Overview

The following sections explain how to read and use the different parts of the Report Library view.

Focus on what's important to you

The following sections explain how you can group and filter information in the Report Library to narrow your focus on the details you need to see.

Search reports by name

When the Report Library includes a wide variety of tests, you can use the Search field at the top to focus on the set of tests you are interested in.

To search reports:

  1. Start typing the name (or any sub-string of the name). Smart Reporting presents a list of suggested available test names.
  2. Do one of the following:

    • Select the test name from the list of suggestions.

    • Complete typing the requested name and press enter.

The list refreshes to display only tests with names that match the search term. If no tests match the search term, a 'No reports found' message appears.

Filter by status

You can use the Statistical Overview area to focus on reports with a selected final status:

  • Click a counter (FailedPassedBlockedUnknown) to filter the list to show only those reports with the selected status.
  • Click Tests to list all test reports.

For example, if 26 tests have a status of Blocked, clicking the Blocked counter filters the list to display only the 26 reports that are currently blocked.

Configure columns

The table may show information that is not relevant at the moment. You can configure it to hide or show columns as needed.

To configure columns:

  1. Click the pliers icon  above the table to display a menu of columns you can configure to appear in the Report Library table.

    Custom fields defined in a test appear as column names at the end of the list.

  2. Select the box next to columns you want to include in the table or clear check boxes of columns you don't want to display.

    Note

    The Report Name and Status columns are not configurable. They are always selected.

Filter or group by custom fields

Use the custom fields defined at the different context classes or as part of the JVM command line parameters (with CI) to refine your results beyond built-in filter categories and tags. Custom fields are <name, value> pairs, so they allow for an additional level of segregation. You can filter and group by custom fields. In addition, you can add a custom field as a column to the report table (see Configure columns).

To filter by custom fields:

  1. In the sidebar, under Filter, click ADD FILTER GROUP and select a value from the list. You may need to scroll down to find the field you are looking for.
    The custom field is added as a filter category.
  2. From the list that opens below the custom field, select a value and whether you want to include or exclude this value.
    The list of reports refreshes to show the updated filter settings.

To group by custom fields:

  • In the sidebar, under Group By, select the required custom field from the list.

Filter by tags

Best Practice: For greater flexibility and more refined filter and group results, we recommend the use of custom fields.

Use the tags defined by the different context classes to better focus the analysis of the test results by filtering the tests to the subset of interest. 

Note

Perfecto tracks up to 3000 tags. If the number of tags in your system exceeds 3000, Perfecto may not find a tag if you try to filter by it.

See Tag-driven reports (RTDD workflow) on how to optimize your test tags for efficient test analysis. 

To filter by tags, do one of the following:

  • In the Tag column, click the tag icon. In the tooltip that displays, click the tag you want to filter by.
  • In the sidebar, under Filter, expand the Tags section and select one or more relevant tags.

The following figure shows the table filtered by the tags iPhone 7 and XCTest. Note the indications of the filtering in the right pane.