View Flaky Score

According to the Flaky Score settings configured in the Configuration, the system calculates Flaky Score and displays it on the test case list view. It allows QA managers and Testers to view the risk probability and test execution history.

Go to the Test Cases module and make the Flaky Score column visible for the list view.

QMetry Test Cases module displaying the column selection menu with the Flaky Score option checked. This allows users to view each test case’s flaky score directly in the test case list. The example shows a test folder named FitTracker with multiple test cases listed under it.

You can view the Flaky Score column, along with its corresponding statistics. You can sort on the column to view test cases with higher flaky scores. You can filter the test cases based on the Flaky Score from Advanced Filters.

Click Flaky Score to view the traceability report for the test case, which shows the test case is associated with which test executions, issues, and execution results. The report helps you further analyze the Flaky Score.

QMetry Test Executions and Issues window displaying a side-by-side view of test runs and associated defects. The example shows test case FIT-TS-34 with one execution marked as Failed under the MacroQ2 cycle and another marked as Passed under R1C2. The related issue FIT-IS-726 is listed with details such as Status: Done, Type: Bug, Priority: High, and Resolution: Done.

If the Flaky Score Settings are changed, the existing Flaky Score will get reset.

The info icon beside the Flaky Score column displays the details of when the score was last generated and by whom.

QMetry Test Cases list showing the Flaky Score (F.S.) column with an information tooltip open. The tooltip displays the last generation details. It also guides users to navigate to the Flaky Score Settings page to update or manage configurations.

View Flaky Score on Test Case Detail Page

The generated Flaky Score is displayed beside the Test Case Key at the top of the screen.

QMetry Test Case Details page displaying the Flaky Score (F.S.) indicator with a value of 0.02 (50%) next to the test case key FIT-TC-147, titled 'Verify Login Details'. The page displays test steps, including “Enter username,” “Enter password,” and dynamic data parameters such as @Employee ID, @User Type, and @Designation.

View Flaky Score on Test Execution Screen

According to the Flaky Score settings configured in the Configuration, the system calculates the Flaky Score. The flaky score indicates the tester's probability of risk while executing the test case and provides a means for comparing pre- and post-test execution results.

Go to the Test Execution screen.

Test Execution Detail View

QMetry Test Execution page for the regression suite FIT-TS-2 displaying multiple test runs. The Flaky Score (F.S.) column highlights varying flakiness levels with color-coded indicators — blue (0.00, 0.02), yellow (0.46), and red (0.96) — representing different degrees of test stability. Other columns include Executed At, Build Name, Execution Type, Success Rate (S.R.), Successor, and Predecessor.

If you go further into the Detail View, you can view the Flaky Score count at the top of the page.

Test Execution Default View

You can show or hide the Flaky Score column on the execution screen.

Click the Flaky Score to drill down to view the test executions and defects associated with the test case.

Publication date: