Test #1 (30 Users)
(A) Test Profile
- Always maintains 30 simultanteous users - 28 Reporters, 2 Reviewers, 1/10sec arrival rate, test duration=60 mins.
- Total users processed is greater than the number of simultanteous users active at any time during the test run.
- This run is repeated to understand if results have changed due to recent changes/fixes (12-19-12) in the COI Test environment.
(B) Test Servers
- Web/App Srv (cf086.serverfarm.cornell.edu)
- DBSvrs (laurel1.cit.cornell.edu and laurel2.cit.cornell.edu)
- Fedora Server
(C) Comparison Criteria Results
Criteria |
Sub Detail |
Value |
Comments |
|---|---|---|---|
Avg Response Time (select pages of interest) |
Reporter: (02) Initial Access |
1.7 secs |
|
|
Reporter: (16) Complete Entity Report |
4.0 secs |
|
|
Reporter: (22) Upload Attachments |
4.4 secs |
|
|
Reporter: (24) Submit Report |
0.4 secs |
|
|
Reviewer: (51) Initial Access |
2.6 secs |
|
|
Reviewer: (52) Submit Report Status |
2.5 secs |
|
Resp Time Requirement |
95% of all Pages |
<= 10 secs |
Passed |
Page Validation |
|
99.9% |
|
Reporter: Total # of Reporters (Processed to End) |
|
353 |
|
Reporter: Num of Reports Submitted |
|
353 |
|
Reporter: Num of Attachments Uploaded |
|
355 |
6 Failed |
Reviewer: Total # of Reviewers (Processed to End) |
|
166 |
|
Reviewer: Num of Report Review Attempts |
|
166 |
|
Note 1: test is stopped 60 mins into test while users are active, therefore counts can show more uploaded documents than reports submitted.
Note 2: Data is from Load Tool Report tabs 'Performance' and 'Application - Custom'.
(D) Comments:
- Test showed similar results to yesterday's run.
- Test shows acceptable response times to user.
- COI cf086 server max CPU utilization ~ 19%.
- Out of 355 attempts to upload a file attachment, 6 failed with server error. See attached below.
- Out of 378 attempts to click 'Start or Update Report' on Main Page, 7 failed with server error. See attached below. Update: On Jan 3, 2013, Brett Haranin made a software change to prevent this error and a rerun of this test confirmed the resolution.
(E) Load Tool Report
(F) Attachment - 500 Server Errors