Test #1 (30 Users)
(A) Test Profile
- Always maintains 30 simultanteous users - 28 Reporters, 2 Reviewers, 1/10sec arrival rate, test duration=60 mins.
- Total users processed is greater than the number of simultanteous users active at any time during the test run.
- This run is repeated to gather more information on errors seen in previous run.
(B) Test Servers
- Web/App Srv (cf086.serverfarm.cornell.edu)
- DBSvrs (laurel1.cit.cornell.edu and laurel2.cit.cornell.edu)
- Fedora Server
(C) Comparison Criteria Results
Criteria |
Sub Detail |
Value |
Comments |
|---|---|---|---|
Avg Response Time (select pages of interest) |
Reporter: (02) Initial Access |
1.8 secs |
|
|
Reporter: (16) Complete Entity Report |
4.2 secs |
|
|
Reporter: (22) Upload Attachments |
4.4 secs |
|
|
Reporter: (24) Submit Report |
0.7 secs |
|
|
Reviewer: (51) Initial Access |
5.0 secs |
|
|
Reviewer: (52) Submit Report Status |
6.1 secs |
|
Resp Time Requirement |
95% of all Pages |
<= 10 secs |
Passed |
Page Validation |
|
99.9% |
|
Reporter: Total # of Reporters (Processed to End) |
|
373 |
|
Reporter: Num of Reports Submitted |
|
373 |
|
Reporter: Num of Attachments Uploaded |
|
376 |
7 Failed |
Reviewer: Total # of Reviewers (Processed to End) |
|
143 |
|
Reviewer: Num of Report Review Attempts |
|
143 |
|
Note 1: test is stopped 60 mins into test while users are active, therefore counts can show more uploaded documents than reports submitted.
Note 2: Data is from Load Tool Report tabs 'Performance' and 'Application - Custom'.
(D) Comments:
- Test shows acceptable response times to user.
- COI cf086 server max CPU utilization ~ 19%.
- Out of 376 attempts to upload a file attachment, 7 failed with server error. See attached below.
- Out of 397 attempts to click 'Start or Update Report' on Main Page, 2 failed with server error. See attached below.
- Response times for the 2 Reviewer users increases over time during 1 hr run but still within acceptable limits (load tool report tab 'Response vs Time Detail' shows increasing time slope for Reviewers only). This may be due to simulation method where all reporters are being reviewed by same reviewer netid (as529 - Andy Szeto) and list of reports increases at a faster rate than reports can be reviewed. Would not be a normal real-life situation and could possible be an exception.
(E) Load Tool Report
(F) Attachment - 500 Server Errors
Note:
- test-5crs00592_Failed_COI_Document_Upload.html is the filename with upload error. User is test-5crs00592. ReportID is 2011-test-5crs00592-A.0
- test-5crs00740_Failed_Page3_Chk.html is the filename with error when clicking on 'Start or Update Report'.