Test #1 (10 Users)
(A) Test Profile
- Always maintains 10 simultanteous users: 9 Reporters with file attachment, 1 Reviewer, 1/20 sec arrival rate, test duration=5 hrs.
- Approximately 80 Report submits/hr, and 80 file attachment uploads per hr.
- Size of uploaded file = 895 KB, filename = "ResearchDocument<1-9999>"
- Total users processed is greater than the number of simultanteous users active at any time during the test run.
(B) Test Servers
- Web/App Srv (cf086.serverfarm.cornell.edu)
- DBSvrs (laurel1.cit.cornell.edu and laurel2.cit.cornell.edu)
- Fedora Server
(C) Comparison Criteria Results
Criteria |
Sub Detail |
Value |
Comments |
|---|---|---|---|
Avg Response Time (select pages of interest) |
Reporter: (02) Initial Access |
3.5 secs |
|
|
Reporter: (16) Complete Entity Report |
4.6 secs |
|
|
Reporter: (22) Upload Attachments |
5.4 secs |
|
|
Reporter: (24) Submit Report |
1.1 secs |
|
|
Reviewer: (51) Initial Access |
16.0 secs |
|
|
Reviewer: (52) Submit Report Status |
22.5 secs |
|
Resp Time Requirement |
95% of all Pages |
|
|
Page Validation |
|
94.2% |
|
Reporter: Total # of Reporters (Processed to End) |
|
n/a |
|
Reporter: Num of Reports Submitted |
|
420 |
21 Failed |
Reporter: Num of Attachments Uploaded |
|
392 |
49 Failed |
Reviewer: Total # of Reviewers (Processed to End) |
|
n/a |
|
Reviewer: Num of Report Review Attempts |
|
n/a |
|
Note 1: Data is from Load Tool Report tabs 'Performance' and 'Application - Custom'.
(D) Comments:
- 16 captured errors with "Conflict of Interest system load is very high. Please try your request later. We apologize for the inconvenience" occurred when either uploading a file or invoking 'Start or Update Report'. Believe more of these types of errors were generated but load script was not set to capture all errors at each user step. Attached file "test-5crs02696_Failed_COI_Document_Upload.html" captures 1 error example to virtual user's (test-5crs02696) screen.
- 36 errors with "fedora.server.errors.GeneralException: A datastream already exists with ID: DS1" occurred when uploading a file. Attached file "test-5crs02735_Failed_COI_Document_Upload.html" captures 1 error example to virtual user's (test-5crs02735) screen.
- 4 errors with "Element CURRENTBASESURVEY is undefined in THIS". Attached file "test-5crs02707_Failed_Page3_Chk.html" provides an example. Recent change provided by Brett Haranin significantly reduced the occurrence of this error, but not eliminate it.
- 2 errors with "nested exception is: java.io.IOException". Using a varied number of upload file names significantly reduced this error, but did not eliminate it. Attached file "test-5crs02494_Failed_COI_Document_Upload.html" provides an example.
- The posted load tool report for this run (link below) shows sporadic slower response times & errors starting after 1 hr & 50 mins into the test run. See tab 'Response vs. Time Detail' which shows a smooth avg for 1st 1 hr & 50 mins and then afterwards the start of intermittent & higher system response time spikes. Also tab 'Verification Point Summary' shows start of errors occurring mostly 2 hrs into test run.
(E) Load Tool Report
(F) Attachment - 500 Server Errors