Skip to main content

View test run result details

The Test Results tab provides detailed information on why your test run achieved a successful (or failed) result of the selected test run.
  1. Go to Reports > Test Runs > Test Runs.
  2. Navigate to the All Test Runs section and click a test run ID to go to its Summary page.
  3. Select the Test Results tab to view them all in a list.
    A complete list of test results.
    1. Click on the Need Review button to filter out results that haven't been linked with any defects yet. Learn more about linking using defects report here: Link test runs to Jira defects in Katalon TestOps.
      The Need Review button to view Defects.
    2. Hover over an error message summary, shown as red text, to view its corresponding error message entirely.
    3. Hover over a linked Defect to quickly view its details. You can also click on Open in Jira to go to the Jira issue directly.
      Hover over a linked defect to peek at its details quickly.
  4. Click on any row to view its results in a pop up menu to the right of the screen. The Result page displays detailed information about the test run. In the example below, the selected test run is deemed as Failed.
    The test result page in pop up view.
    Alternatively, you can click on the blue expand button on the top-left corner of the pop up menu to go to the Result page directly. The Result page provides the following information:

    • Linked Defects: Lists defects linked to this test result. To learn how to do so, see: Submit an issue from Katalon TestOps to Jira.

    • Error Message: Explains the reason behind the execution's failure.

    • Attachments: Captured screenshots and/or recorded videos to see what went wrong with failed tests.

    • Failed Assertions: When you run tests with Katalon Studio and if you have used built-in assertion keywords with the verify prefix (e.g, WebUI.verifyElementPresent) or custom assertion keywords such as KeywordUtil.markPassed(message), KeywordUtil.markFailed(message), KeywordUtil.markFailedAndStop(message), you can see the failed assertions in this section. To know more about assertion in Katalon Studio, see Assert statements.

    • Errors: The full error log. You may download this file.

    • Logs: The execution logs in each test step and the step status. This allows you to quickly troubleshoot which steps cause test failure. You may view this log in text view or tree view.

  5. Navigate to the right side to view more information about your test run result. Test result related informationThis section provides a quick view of the following details in relation to your test run result:

    • Test Suite, Test Case: The test suite and test case executed in the test run.

    • Similar Failures: TestOps analyzes all existing failed test results and identifies similar failed test suites or test cases. Those test runs with similar failures are listed in this section with their hyperlinked IDs.

    • Failure Reason: TestOps automatically assigns failure reason to the corresponding top-level exception of failed test results. You may click on the drop-down and change the suggested reason to a different category. You may also click on Troubleshooting Guideline for more information on how to resolve your failed test suite and/or test case.
      Note:
      • The Failure Reason capability is limited to the Premium and Ultimate plans of Katalon Platform. For more information, see Version 8.0.0 - 8.0.1.

    • Maintainer: The member user assigned as the executed test case's maintainer.

  6. Click the Requests tab to view the API requests received. Test run - API requests
    Click the hyperlinked request ID to view more details of the API requests received.
  7. Click the Test Objects tab to view the test objects executed in the test run. Test ObjectsClick the hyperlinked test object ID to view more details of the test objects executed in the test run.
  8. Click the Similar Failures tab to view other test run failures with similar errors. Similar Failures page.
    Click on any row to view its results in a pop up menu to the right of the screen. The Result page displays detailed information about the test run. Alternatively, you can click on the blue expand button on the top-left corner of the pop up menu to go to the Result page directly.
  9. Click the Comments tab to view all comments for the test run. You may also type in and submit comments for collaboration. Comments
  10. Click the Re-runs tab to view the re-runs of the test run executed in list form. Re-runsYou may also click the hyperlinked re-run execution ID to view more details.