Test Summary Report

Purpose

To summarize the results of the designated testing activities and to provide evaluations based on test execution results. A management report providing any important information uncovered by the tests accomplished, and including assessments of the quality of the testing effort, the quality of the software system under test, and statistics derived from Incident Reports. The report also records what testing was done and how long it took, in order to improve any future test planning. This final document is used to indicate whether the software system under test is fit for purpose according to whether or not it has met acceptance criteria defined by project stakeholders.

Contents
Summary

Chart of Account test items for this test cycle (test cycle 1) were taken from the KFS CoA Test Case Specification Document. From the identified use cases, 42 manual test cases were selected. The test cycle (test cycle 1) was conducted in the KFS-QA environment before it was converted to KFS-TEST. Test Incident reporting is being tracked in a separate Confluence page.

Variances

Of the 42 test cases that were assigned 9 were not run due to manual testers not completing the testing assignment.

Comprehensiveness assessment

The Chart of Accounts Test Plan defines the goals for successful testing of the Chart of Accounts Module. The module functionality that was not sufficiently tested during this test cycle includes, organizations, sub-accounts, and sub-object codes.

Summary of results

During this test cycle 42 test cases were assigned, 9 were not completed by the testers, 18 failed and 15 passed.

Not Run

  • [KFSQA-93] - Test: Create New Account Delegate (COA15.1-pos-1)
  • [KFSQA-95] - Test: Edit Account Delegate (COA15.3-pos-1)
  • [KFSQA-96] - Test: Copy Account Delegate (COA15.6-pos-1)
  • [KFSQA-113] - Test: Search New Chart (COA4.2-pos-1 Report)
  • [KFSQA-114] - Test: Edit Chart (COA4.3-pos-1)
  • [KFSQA-115] - Test: Edit Inactivate Chart (COA4.4-neg-1)
  • [KFSQA-116] - Test: Edit Inactivate Chart (COA4.4-pos-1)
  • [KFSQA-119] - Test: Chart Edit Reactivate (COA4.5-pos-1 Report)
  • [KFSQA-120] - Test: Chart Copy (COA4.6-pos-1 Report)

Failed

  • [KFSQA-81] - Test: Create New Sub-Account (COA8.1-pos-1)
  • [KFSQA-83] - Test: Edit Sub-Account (COA8.3-pos-1)
  • [KFSQA-84] - Test: Copy Sub-Account (COA8.6-pos-1)
  • [KFSQA-85] - Test: Create New Object Code (COA9.1-pos-1)
  • [KFSQA-87] - Test: Edit Object Code (COA9.3-pos-1)
  • [KFSQA-88] - Test: Copy Object Code (COA9.6-pos-1)
  • [KFSQA-89] - Test: Create New Sub-Object Code (COA10.1-pos-1)
  • [KFSQA-91] - Test: Edit Sub-Object Code (COA10.3-pos-1)
  • [KFSQA-92] - Test: Copy Sub-Object Code (COA10.6-pos-1)
  • [KFSQA-94] - Test: Search Account Delegate (COA15.2-pos-1)
  • [KFSQA-98] - Test: Search Organization Review (COA18.2-pos-1)
  • [KFSQA-101] - Test: Create New Organization (COA5.1-pos-1)
  • [KFSQA-103] - Test: Edit Organization (COA5.3-pos-1)
  • [KFSQA-104] - Test: Copy Organization (COA5.6-pos-1)
  • [KFSQA-105] - Test: Global Account (COA14-pos-1)
  • [KFSQA-106] - Test: Account Delegate Global (COA16-pos-1 Report)
  • [KFSQA-107] - Test: Sub-Object Code Global (COA17-pos-1 Report)
  • [KFSQA-112] - Test: Create New Chart (COA4.1-pos-1 Report)

Passed

  • [KFSQA-77] - Test: Create New Account (COA7.1-pos-1)
  • [KFSQA-78] - Test: Search Account (COA7.2-pos-1)
  • [KFSQA-79] - Test: Edit Account (COA7.3-pos-1)
  • [KFSQA-80] - Test: Copy Account (COA7.6-pos-1)
  • [KFSQA-82] - Test: Search Sub-Account (COA8.2-pos-1)
  • [KFSQA-86] - Test: Search Object Code (COA9.2-pos-1)
  • [KFSQA-90] - Test: Search Sub-Object Code (COA10.2-pos-1)
  • [KFSQA-97] - Test: Create New Organization Review (COA18.1-pos-1)
  • [KFSQA-99] - Test: Edit Organization Review (COA18.3-pos-1)
  • [KFSQA-100] - Test: Copy Organization Review (COA18.6-pos-1)
  • [KFSQA-102] - Test: Search Organization (COA5.2-pos-1)
  • [KFSQA-108] - Test: Search Account Type (COA6.2 Acct Type Search)
  • [KFSQA-109] - Test: Balance Type Search(COA6.2 Balance Type Search)
  • [KFSQA-110] - Test: Sub-Fund Group Search(COA6.2 Sub-Fund Group Search)
  • [KFSQA-111] - Test: KFS System User Role(COA6KFS-Sys User Role)
Evaluation

Of the 33 test cases that were run, the 15 that passed tested 5 high risk areas of functionality (Risk Priority of Extensive). The remaining 10 passing tests covered moderate risk functionality (Risk Priority of Broad). The 18 failed test cases will be corrected by adding a step to backdoor login as dh273 (Dave) and reassigned in test cycle 2. The 9 test cases that were not completed by the testers, did not meet the release criteria for the test cycle and will need to be reassigned in test cycle 2.

Summary of activities

A campus testers workshop was conducted to train 31 campus testers on KFS manual testing methodology. The Test cases were assigned starting on 11/23, the testers were asked to complete the testing by 12/1. There was a power interruption to the Rhodes Hall server room that caused some delays in testing. Manual testing coordination was done by Susan Wakshlag. In the future we are going to ask testers to complete testing within 2 business days. If that isn't possible we will ask that they let us know so the test cases can be reassigned.

Approvals

Dave Hegelein

  • No labels