Test Type (Baseline Test)
Note 1: Baseline test runs at a low load level, as a sanity test of, P90 Piscataway env, load scripts, & test data, and to also set the initial benchmarks.
(A) Test Profile
- 3 Apache/Weblogic servers
- 4 AppSvrsApplication servers
- DB P90SCOR
- Profile: 3350 students, 1 students/2sec arrival rate create ~ 100 concurrent users.
- Profile: No 1500 advance sign-in at 6/sec, then enrollment is enabled; not needed for baseline.
- Profile: Spring 2015 Pre-Enrollment simulationterm.
- Profile: See high-level setup requirements in Confluence for additional information.
(B) General Kernel or Linux config of interest
- unused at the current time - for team to uniquely identify a test for future reference
- (when important, David B. and Tim C. provides Andy to record)
(C) WebServer (apache/weblogic) config of interest
- unused at the current time
(D) AppServer config on interest
- unused at the current time
(E) DB config on interest
- unused at the current time
...
Criteria | Sub Detail | Value | Comments |
|---|---|---|---|
Avg Response Time | |||
<= 3.5 secs | Student Center (03) | 2.9 3 secs | Pass |
<= 3.5 secs | Class Schedule (04) | 21.7 secs | Pass |
<= 1.5 secs | Input Class (06) | 0.9 2 secs | Pass |
<= 2.5 secs | Finish Enroll (09) | 20.1 8 secs | Pass |
<= 30 secs | Finish Enroll (wine) | 28 0.8 secs | Pass |
Resp Time Percentile Requirement | All Pages 85% <= 85% | 6 secs | Pass |
All Pages 90% <= 90% | 8 secs | Pass | |
All Pages 95% <= 95% | 10 secs | Pass | |
Expected Enrolled Classes Actual (RPT) Enrolled Classes Actual (DB) Enrolled Classes Known Acceptable Errors Errors, Missing or Unknown (<=50) | 3350 students, 6 classes, >= 99.75% >= 99.75%
(<=50) | 20,100 20,098 20,098 2 0 |
Pass Pass Already Enrolled Pass |
Searches Pass Searches Fail | >=98% | 2,109 0 | Pass |
Page Title % Verification Page Element % Verification | All Pages >= 99% All Pages >= 98%
| 100% 100% | Pass Pass |
HTTP 500 errors | = 0 | 0 | Pass |
Finish Enroll errors (COBOL or DB) | = 0 | 0 | Pass |
Comments:
- Page Title Verification = 100%, Pass.
- Page Element Verification = 100%, Pass
- Response Time Percentile Requirements: 3 Pass, 0 Fail
- No HTTP 500 errors, No Finish Enroll errorsAll requirements passing.
Load Tool Report
http://testtoolsvm2.cit.cornell.edu/RPT_Runs/CourseEnroll/LinuxVM/08-20-13_T1/PS_to_ATT/P90/04-21-15-Baseline-Hformat2/Sched_PreEnroll76classes-7T0_Test-3av1_v6Apr-630am-new8-3000VU-ExtIP-T1_Percentile-v7_Aug-20-1_10-43AM.html21-15_1-26PM.html
(Note: Graphs in link above will display a bit better in IE or Firefox vs.Chrome)