Test Type (Baseline Test)
Note 1: This baseline Baseline test runs at a low load levels level, as a sanity test of, P90 Piscataway env, load scriptscripts, & test data, and to set the initial benchmarks.
(A) Test Profile-
- 3 Apache/Weblogic servers
...
- 4
...
- Application servers
...
- DB P90SCOR
...
- Profile: 3350 students, 1 students/2sec arrival rate create ~ 100 concurrent users.
...
- Profile: No 1500 advance sign-in at 6/sec, then enrollment is enabled
...
- .
...
- Profile: Spring 2015 Pre-Enrollment
...
- term.
...
- Profile: See high-level setup requirements in Confluence for additional information.
(B) General Kernel or Linux config of interest
- unused at the current time - for team to uniquely identify a test for future reference
- (when important, David B. and Tim C. provides Andy to record)
(C) WebServer (apache/weblogic) config of interest
- unused at the current time
(D) AppServer config on interest
- unused at the current time
(E) DB config on interest
- unused at the current time
(F) Comparison Criteria Results
Criteria | Sub Detail | Value | Comments | |||
|---|---|---|---|---|---|---|
Avg Response Time | ||||||
<= 3.5 secs | Student Center (03) | 2.9 3 secs | July 12 run was 2.7 | Pass | ||
<= 3.5 secs | Class Schedule (04) | 21.7 secs | July 12 run was 2.3 | Pass | ||
<= 1.5 secs | Input Class (06)Input Class | 0.9 2 secs | July 12 run was 0.7 | |||
Finish Enroll | 2.1 secs | July 12 run was 1.5 | ||||
| Pass | ||||||
<= 2.5 secs | Finish Enroll (09) | 0.8 secs | Pass | |||
<= 30 secs | Finish Enroll (wine) | 350.6 8 secsJuly 12 run was 33.8 | Pass | |||
Resp Time Percentile Requirement | All Pages 85% <= 85% | 6 secs | Pass | |||
All Pages 90% <= 90% | 8 secs | Pass | ||||
All Pages 95% <= 95% | 10 secs | Pass | ||||
Num of Enrolled Classes | 48,689 | July 12 run was 49,775 | ||||
Num of Search Attempts | 8,222 | was 8355 | ||||
Expected Enrolled Classes Actual (RPT) Enrolled Classes Actual (DB) Enrolled Classes Known Acceptable Errors Errors, Missing or Unknown | 3350 students, 6 classes, >= 99.75% >= 99.75%
(<=50) | 20,100 20,098 20,098 2 0 |
Pass Pass Already Enrolled Pass | |||
Searches Pass Searches Fail | >=98% | 2,109 0 | Pass | |||
Page Title % Verification Page Element % Verification | >= 99% >= 98%
| 100% 100% | Pass | Summary Verification % | All Pages > 95% | 100% Pass |
HTTP 500 errors | = 0 | 0 | Pass | |||
Finish Enroll errors (COBOL or DB) | = 0 | 0 | Pass |
Comments:
- Summary Verification 100% - Pass. (99.96% was averaged up to 100% by load tool report)
- Response Time Percentile Requirements: 3 Pass, 0 Fail (RPT tab 'Perf Requirements').
- No HTTP 500 errors, No Finish Enroll errors.
- All requirements passing.
Load Tool Report
http://testtoolsvm2.cit.cornell.edu/RPT_Runs/CourseEnroll/LinuxVM/08-20-13_T1/PS_to_ATT/P90/04-21-15-Baseline-Hformat2/Sched_PreEnroll76classes-7T0_Test-3av1_v6Apr-630am-new8-3000VU-ExtIP-T1_Percentile-v7_Aug-20-1_10-43AM.html21-15_1-26PM.html
(Note: Graphs in link above will display a bit better in IE or Firefox vs.Chrome)