Test step analysis module - feature overview

The following article describes the features of the Test step analysis module located in the Reporting section of the Analytics application. For an intro to Test step analysis see this article.

Filter

As is standard in many of the modules in the Analytics application, a filter must be applied before using the features of the Test step analysis module. If can be used to narrow the data to be analyzed based on levels, product groups, processes etc.

Sequence grid

Next the sequence grid is used to identify which sequences to analyze as well as giving a high level overview of yield and other metrics. Select one or more sequences of interest and press the Analyze selected button to drill further down into the data.

Choosing sequences to analyze.

Step grid
Once one or more sequences has been applied, a grid containing all steps in these sequences are displayed. If multiple sequences are selected, WATS will merge all steps into one list. To influence how this merge is performed change the Query options in the grid toolbar.

Changing query options.

The step list toolbar also contains the ability to display data for different runs and well as large selection of columns to choose from. This includes multiple types of metric like Cpk and step execution time. The Suggestions column will indicate that WATS Alvea has identified certain steps that might be of interest to the user. 

From the Step grid, further analysis can be performed on one or more steps by opening Step details. For more information about Step details see the following article.

Charts

Below the Step grid multiple charts are rendered to provide a summary of several aspects of the Step grid:

• Top 10 steps by failed / error / terminated: A pareto indicating which steps is causing the most issues in the chosen sequence(s).
• Top 10 steps by lowest Cpk value: Determine worst Cpk values either by all or only passed steps.
• Top 10 steps by average step time: Longest running steps by average.
• Top 10 steps by Passed status and step time: Identifies steps which while Passed might be costly due to long execution times.

Like the Step grid, all the charts can also be used to analyze the steps further by opening Step details. Simply click on any series to open a menu to further analyze the steps in question. Note that in addition to the 10 steps, each chart contains the steps not in top 10 grouped in a category called other. Clicking this will expand the chart to show all steps instead of top 10.

Open Step details from a chart

Expand to show all steps