Test #1 (10 Users)
(A) Test Profile
- Always maintains 10 simultanteous users - 8 Reporters with no attachment, 1 Reporter with file attachment, 1 Reviewers, 1/20 sec arrival rate, test duration=5 hrs.
- Approximately 80 Reporter submits/hr, and file attachment uploads per hr.
- Size of uploaded file = 895 KB, filename = "ResearchDocument<1-9999>"
- Total users processed is greater than the number of simultanteous users active at any time during the test run.
(B) Test Servers
- Web/App Srv (cf086.serverfarm.cornell.edu)
- DBSvrs (laurel1.cit.cornell.edu and laurel2.cit.cornell.edu)
- Fedora Server
(C) Comparison Criteria Results
Criteria |
Sub Detail |
Value |
Comments |
---|---|---|---|
Avg Response Time (select pages of interest) |
Reporter: (02) Initial Access |
3.5 secs |
|
|
Reporter: (16) Complete Entity Report |
4.6 secs |
|
|
Reporter: (22) Upload Attachments |
5.4 secs |
|
|
Reporter: (24) Submit Report |
1.1 secs |
|
|
Reviewer: (51) Initial Access |
16.0 secs |
|
|
Reviewer: (52) Submit Report Status |
22.5 secs |
|
Resp Time Requirement |
95% of all Pages |
|
|
Page Validation |
|
94.2% |
|
Reporter: Total # of Reporters (Processed to End) |
|
n/a |
|
Reporter: Num of Reports Submitted |
|
420 |
21 Failed |
Reporter: Num of Attachments Uploaded |
|
392 |
49 Failed |
Reviewer: Total # of Reviewers (Processed to End) |
|
n/a |
|
Reviewer: Num of Report Review Attempts |
|
n/a |
|
Note 1: Data is from Load Tool Report tabs 'Performance' and 'Application - Custom'.
(D) Comments:
- 16 captured errors with "Conflict of Interest system load is very high. Please try your request later. We apologize for the inconvenience" occurred when either uploading a file or invoking 'Start or Update Report'. Believe more of these types of errors were generated but load script was not set to capture all errors at each user step. Attached file "test-5crs02696_Failed_COI_Document_Upload.html" captures 1 error example to virtual user's (test-5crs02696) screen.
- 36 errors with "fedora.server.errors.GeneralException: A datastream already exists with ID: DS1" occurred when uploading a file. Attached file "test-5crs02735_Failed_COI_Document_Upload.html" captures 1 error example to virtual user's (test-5crs02735) screen.
- 4 errors with "Element CURRENTBASESURVEY is undefined in THIS". Attached file "test-5crs02707_Failed_Page3_Chk.html" provides an example. Recent change provided by Brett Haranin significantly reduced the occurrence of this error, but not eliminate it.
- 2 errors with "nested exception is: java.io.IOException". Using a varied number of upload file names significantly reduced this error, but did not eliminate it. Attached file "test-5crs02494_Failed_COI_Document_Upload.html" provides an example.
(E) Load Tool Report
(F) Attachment - 500 Server Errors