Test Type (Baseline Test)

  Note 1: Baseline test runs at a low load level, as a sanity test of, P90 Piscataway env, load scripts, & test data, and to set the initial benchmarks.

 

(A) Test Profile

  • 3 Apache/Weblogic servers
  • 4 Application servers
  • DB P90SCOR
  1. Profile: 3350 students, 1 students/2sec arrival rate create ~ 100 concurrent users.
  2. Profile: No 1500 advance sign-in at 6/sec, then enrollment is enabled. 
  3. Profile: Spring 2015 Pre-Enrollment term.
  4. Profile: See high-level setup requirements in Confluence for additional information.

 

(B) General Kernel or Linux config of interest

  • unused at the current time - for team to uniquely identify a test for future reference
  • (when important, David B. and Tim C. provides Andy to record)

(C) WebServer (apache/weblogic) config of interest

  • unused at the current time

(D) AppServer config on interest

  • unused at the current time

(E) DB config on interest

  • unused at the current time



(F) Comparison Criteria Results

Criteria

Sub Detail

Value

Comments

Avg Response Time

   

<= 3.5 secs

Student Center (03)

2.3 secs

Pass

<= 3.5 secs

Class Schedule (04)

1.7 secs

Pass

<= 1.5 secs

Input Class (06)

0.2 secs

Pass

<= 2.5 secs

Finish Enroll (09)

0.8 secs

Pass

<= 30 secs

Finish Enroll (wine)

0.8 secs

Pass

Resp Time Percentile Requirement

All Pages 85% <=

6 secs

Pass

 

All Pages 90% <=

8 secs

Pass

 

All Pages 95% <=

10 secs

Pass

Expected Enrolled Classes

Actual (RPT) Enrolled Classes

Actual (DB) Enrolled Classes

Known Acceptable Errors

Errors, Missing or Unknown

3350 students, 6 classes,

 >= 99.75%

 >= 99.75%

  

(<=50)

20,100

20,098

20,098

2

0

 

Pass

Pass

Already Enrolled

Pass

Searches Pass

Searches Fail

 >=98%

2,109

0

Pass

Page Title % Verification

Page Element % Verification

All Pages >= 99%

All Pages >= 98%

 

100%

100%

Pass

Pass

HTTP 500 errors

= 0

0

Pass

Finish Enroll errors (COBOL or DB)

 = 0

0

Pass

 

Comments:

  • Page Title Verification = 100%, Pass.
  • Page Element Verification = 100%, Pass
  • Response Time Percentile Requirements: 3 Pass, 0 Fail
  • No HTTP 500 errors, No Finish Enroll errors.

 

Load Tool Report

http://testtoolsvm2.cit.cornell.edu/RPT_Runs/CourseEnroll/PS_to_ATT/P90/04-21-15-Baseline-Hformat2/Sched_6classes-T0_v1_Apr-21-15_1-26PM.html

(Note: Graphs in link above will display a bit better in IE or Firefox vs.Chrome)

 

 

  • No labels