...
- Always maintains 30 simultanteous users - 28 Reporters, 2 Reviewers, 1/10sec arrival rate, test duration=60 mins.
- After a group of 30 users has submitted a report, another group of 30 users is working to submit reports. Total users processed is greater than the number of simultanteous users active during at any time during the test run.
(B) Test Servers
- Web/App Srv (cf086.serverfarm.cornell.edu)
- DBSvrs (laurel1.cit.cornell.edu and laurel2.cit.cornell.edu)
- Fedora SvrServer
(C) Comparison Criteria Results
Criteria | Sub Detail | Value | Comments |
|---|---|---|---|
Avg Response Time (select pages of interest) | Reporter: (02) Initial Access | 1.7 secs |
|
| Reporter: (16) Complete Entity Report | 4.0 secs |
|
| Reporter: (22) Upload Attachments | 4.3 secs |
|
| Reporter: (24) Submit Report | 0.4 secs |
|
| Reviewer: (51) Initial Access | 2.9 secs |
|
| Reviewer: (52) Submit Report Status | 2.9 secs |
|
Resp Time Requirement | All 95% of all Pages 95% | <= 10 secs | Passed |
Page Validation |
| 98.4% |
|
Reporter: Total # of Reporters (Processed to End) Reporter: Num of Reports Submitted |
| 45 297 |
|
Reporter: Num of Reports Submitted |
| 45 291 | 6 Failed |
Reporter: Num of Attachments Uploaded |
| 300 |
|
Reviewer: Total # of Reviewers (Processed to End) |
| 94 45 |
|
Reviewer: Num of Reports Reviewed Report Review Attempts |
| 94 5 |
|
Note 1: test is stopped 60 mins into test while users are active, therefore counts can show more uploaded documents than reports submitted.
Note 2: Data is from Load Tool Report tabs 'Performance' and 'Application - Custom'.
(D) Comments:- Verdict: Pass
- Good Sanity Test Run
- Test shows acceptable response times to user.
- COI cf086 server max CPU utilization ~ 15%.
- CF JVM monitoring results acceptable (Nazrin).
- Out of 297 attempts to submit a COI Report for review, 6 of these failed.
- Test will be repeated to reproduce failures & attempt to capture additional information.
- Response times for the 2 Reviewer users increase over time during 1 hr run but still within acceptable limits (load tool report tab 'Response vs Time Detail' shows increasing time slope for Reviewers only). Upcoming 6 hr test run should reveal if there's an issue.
(E) Load Tool Report
http://testtoolsvm1.cit.cornell.edu/RPT_Runs/COI/12-1118-12_DryRun1030User/Sched_COI_Reporters_Reviewers_v1-DryRun10Run30_Dec-1118-12_910-40AM08AM.html