Test Results
(A) Test Profile
- There are always 30 unique users active in the test during the 7 hr test run, consisting of 28 Reporters & 2 Reviewers.
- 459 Reporter Users are processed.
- Workload rate is ~ 65 COI report submits/hr, 1 file attachment upload/hr
- Arrival rate of 1 new user every 20 secs at beginning of test.
- Size of uploaded file = 895 KB, filename = "DUnivDoc<1-999999>"
(B) Test Environment
- Web/App Srv (cf086.serverfarm.cornell.edu)
- DBSvrs (oxton110), DB (raistest)
- Fedora Server (dev)
(C) Comparison Criteria Results
Criteria |
Sub Detail |
2014 Release |
2013 Release |
|---|---|---|---|
Avg Response Time (select pages of interest) |
Reporter: (02) Initial Access |
1.4 sec avg |
2.0 sec avg |
|
Reporter: (05) Upload Attachments |
2.5 sec avg |
14.8 sec avg |
|
Reporter: (24) Submit Report |
0.5 sec avg |
0.4 sec avg |
|
Reviewer: (51) Initial Access |
2.6 sec avg |
4.1 sec avg |
|
Reviewer: (52) Submit Report Status |
3.8 sec avg |
5.0 sec avg |
Requirements |
Percent Page VPs Passed >= 99% |
100% |
99.9% |
|
85th Percentile Response Time for all pages <= 3 secs |
Pass |
Pass |
|
90th Percentile Response Time for all pages <= 4 secs |
Pass |
Pass |
|
95th Percentile Response Time for all pages <= 5 secs |
Pass |
Pass |
Reporter: Total # of Reporters (Processed to End) |
|
459 |
468 |
Reporter: Num of Reports Submitted Successfully |
|
459 |
466 |
Reporter: Num of Attachments Uploaded |
|
15 |
15 |
Reviewer: Num of Report Review Attempts |
|
344 |
526 |
Note 1: Data is from Load Tool Report tab = 'Performance' and 'AppCustom'.
(D) Comments:
- Test Verdict: Pass (no significant issues seen in test results or OEM monitoring)
- Config change to COI CF 'post parameter limit' paramter to value=3000 resolved previously discovered load limit before this run was initiated.
- Only one HTTP 500 error occurred during Reviewer Approval which was non-affecting to moving report to status "No Conflict Exists".
Error Details: Reviewer-as529_Failed_COI_Document_ReviewApproved-sav.html
(E) Load Tool Report
(F) Attachment - Profile data from COI production activity to build test profile.
Load Stats - sorted by day.docx