Test Type 1 (most challenging profile, immediate load rush)
Note 1: This run uses changed workload profile to allow for the peak interval throughput to run longer.
Note 2: New Environment: Lotus RAC Cluster, 2 nodes - HP ProLiant BL460c G7, Linux, PeopleSoft, DB = PSLDTST, Course Enrollment)
Note 3: Apache parameter changes for this test run are listed below to reduce the number of connections that apache has to make back to weblogic (Tim Cornwell).
(A) Test Profile
- 5 Apache/Weblogic (LinuxVM: 8G & 3 CPUs - sf-psleg-np003, sf-psleg-np021, sf-psleg-np022, sf-psleg-np034, sf-psleg-np035))
- 10 AppSvrs (LinuxVM: 8G & 4 CPUs - sf-psleg-np002, sf-psleg-np006, sf-psleg-np009, sf-psleg-np010, sf-psleg-np011, sf-psleg-np025, sf-psleg-np026, sf-psleg-np027, sf-psleg-np036, sf-psleg-np037)
- DB psldtst (Lotus RAC Cluster, Linux in RAC with Oracle 11gR2, Instance from 1/25/13 copy of PeopleSoft Prod)
...
- KeepAliveTimeout 5
- StartServers 100
- MinSpareServers & MaxSpareServers 100
- MaxClients 4096
- JVM (JRockit 64bit 6Gb)
- apache KeepAliveTimeout: KeepAliveTimeout 5 changed to KeepAliveTimeout 15.
- weblogic JVM changed to match current production: Was 6g changed to 3g.
- kernel.msgmni = 1024 changed to kernel.msgmni = 2878
- joltPooling=true
- parallelLoading=true
- KeepAliveEnabled ON <---- Change 1 for this test run (Tim Cornwell).
- KeepAliveSecs 15 <---------- Change 2 for this test run (Tim Cornwell).
(D) AppServer config on interest
...
Criteria | Sub Detail | Value | Comments |
---|---|---|---|
Avg Response Time |
|
| |
| Student Center | 2.6 9 secs July | Aug 20 run 2 was 2.6 12 run was 2.7 |
| Class Schedule | 2.5 7 secs July 12 run was 2.3 | Aug 20 run 2 was 2.5 |
| Input Class | 0.7 8 secs | July 12 Aug 20 run 2 was 0.7 |
| Finish Enroll | 1.7 secs | July 12 run Aug 20 run 2 was 1.5 7 |
| Finish Enroll (wine) | 31 37.2 8 secs July | Aug 20 run 2 was 31.2 12 run was 33.8 |
Resp Time Percentile Requirement | All Pages 85% <= | 6 secs | Pass |
| All Pages 90% <= | 8 secs | Pass |
| All Pages 95% <= | 10 secs | Pass |
Num of Enrolled Classes |
| 49 48,728 571 | July 12 Aug 20 run 2 was 49,775 728 |
Num of Search Attempts |
| 8,265 290 | Aug 20 run 2 was 8,265 was 8355 |
Summary Verification % | All Pages > 95% | 100% | Pass |
HTTP 500 errors |
| 0 | |
Finish Enroll errors (COBOL or DB) |
| 0 |
...
- Summary Verification 100% - Pass. (99.96% was averaged up to 100% by load tool report)
- Response Time Percentile Requirements: 3 Pass, 0 Fail (RPT tab 'Perf Requirements').
- No HTTP 500 errors, No Finish Enroll errors.
Load Tool Report
http://testtoolsvm2.cit.cornell.edu/RPT_Runs/CourseEnroll/LinuxVM/10-1718-13_run1run2/Sched_PreEnroll7-7_Test-3a_v6-630am-new8-3000VU-ExtIP-T1_Percentile-v7-RPTFix2_Oct-1618-13_51-14PM02PM.html
\[Note: Test profile challenges infrastructure at higher than normal peak incoming rates, with 1500 authenticated students signing in early, the clicking on AddClass tab selection every 15 secs until enrollment is enabled, with remaining students entering at 6 new users/sec. Various combinations of AddClass scripts used only in this testing, no Drops or Swaps due to issue with psldtst env setup (or change) affecting scripts. Was not considered necessary to rebuild these scripts at this time for inclusion in test runs based on goals of this testing.\]
\\with 1500 authenticated students signing in early, the clicking on AddClass tab selection every 15 secs until enrollment is enabled, with remaining students entering at 6 new users/sec. Various combinations of AddClass scripts used only in this testing, no Drops or Swaps due to issue with psldtst env setup (or change) affecting scripts. Was not considered necessary to rebuild these scripts at this time for inclusion in test runs based on goals of this testing.] Wiki Markup
Test Type 2 (less challenging profile, gradual load increase -- These are last results run on Dec 20 2012 -- Test Type 2 retired for now.)
(A) Test Profile
- 3 WebSrvs (Solaris: 16G & 32 CPUs - spiraea, tuberose, woodruff)
- 3 Weblogic (LinuxVM: 8G & 2 CPUs - sf-psleg-np003, sf-psleg-np021, sf-psleg-np022)
- 5 AppSvrs (LinuxVM: 8G & 4 CPUs - sf-psleg-np002, sf-psleg-np006, sf-psleg-np009, sf-psleg-np010, sf-psleg-np011)
...
- Avg page response times improved from yesterday's run.
- There was no queuing detected in the tuxedo queues for PSAPPSRV services. (Tim Cornwell)
- CPU utilization for the 5 App servers was higher than previous tests. Roughly 50-60%. This is a pretty comfortable level under this load. (Tim Cornwell)
- Memory utilization less than 100% - no swapping detected. (Tim Cornwell)
- Excellent passing results.
Load Tool Report
\[Note: Test Profile gradually increases load. This is good for indentifying points in the load increase that are related to system degradations. AddClass only used, no Drops or Swaps due to issue with psldtst env setup (or change) affecting scripts. Was not considered necessary to rebuild these scripts at this time for inclusion in test runs based on goals of this testing.\load increase that are related to system degradations. AddClass only used, no Drops or Swaps due to issue with psldtst env setup (or change) affecting scripts. Was not considered necessary to rebuild these scripts at this time for inclusion in test runs based on goals of this testing.] Wiki Markup
Test Type 3 (Sanity test, run on July 9, 2013)
Note 1: This run uses changed workload profile to allow for the peak interval throughput to run longer.
Note 2: New Environment: Lotus RAC Cluster, 2 nodes - HP ProLiant BL460c G7, Linux, PeopleSoft, DB = PSLDTST, Course Enrollment)
Note 3: Enabled splunkforwarder, disabled debug on apache, COBOL license installed manually and all COBOL source files recompiled, env restarted too. <---- Primary changes for this run.
(A) Test Profile
- 3 Apache/Weblogic (LinuxVM: 8G & 3 CPUs - sf-psleg-np003, sf-psleg-np021, sf-psleg-np022)
- 10 AppSvrs (LinuxVM: 8G & 4 CPUs - sf-psleg-np002, sf-psleg-np006, sf-psleg-np009, sf-psleg-np010, sf-psleg-np011, sf-psleg-np025, sf-psleg-np026, sf-psleg-np027, sf-psleg-np036, sf-psleg-np037) <---- Change to 10 AppSvrs
- DB psldtst (Lotus RAC Cluster, Linux in RAC with Oracle 11gR2, Instance from 1/25/13 copy of PeopleSoft Prod)
...
http://testtoolsvm2.cit.cornell.edu/RPT_Runs/CourseEnroll/LinuxVM/07-09-13_T3-sanity/Sched_PreEnroll7-7_Test-3a_v6-630am-new8-3000VU-ExtIP-T3_Percentile-v6-Sanity_July-09-13_10-08AM.html
unmigrated-wiki-markup
\[Note: Test profile represents a sanity test to ensure the integrity of the system.\]
\\