SlideShare una empresa de Scribd logo
1 de 2
Descargar para leer sin conexión
CASE STUDY


Pre-deployment Performance
Evaluation of Web-based Product

                                                     STAG certifies an eLearning product ‘deploy-ready’
                                                      after extensive LSPS evaluation, enabling our
                                                      partner to successfully deploy it at the world's
                                                      largest publicly funded health services
                                                      organization.



                                                                Technology - Web-based eLearning LCMS,
                                                                Microsoft 2003 Server and Cold Fusion 8,
             Domain - Health Care                               Web Server with Database Server (SQL Server 2005)
                                                                Tools - JMeter, AdventNet AppManager



CUSTOMER AND PRODUCT BACKGROUND
The customer is one of the world’s largest publicly funded health services providers based out of the UK, employing more
than 1.7 million people, including 120,000 hospital doctors, 40,000 general practitioners, 400,000 nurses, and 25,000
ambulance staff.


The product in question is an eLearning product developed by our UK partner. This tool covers a wide range of training
needs and learning competencies to support the implementation and development of an information governance
framework within an organization.


PROBLEM STATEMENT
Our UK partner sought our expertise in LSPS evaluation of the product, as desired by the customer before its deployment
at the customer's place, for the following:

•   Load and performance capability
•   Ability to withstand concurrent loads
•   System scalability
•   Identification of potential bottlenecks (hardware, software, or network)

An estimated 37,500 concurrent users were expected at peak usage times.
SOLUTION
The STAG team created the necessary test environment,
developed a scalable automation framework, created a load                                     Number of users: 15,000
profile, developed performance test scripts, and created test                                  Bandwidth consumed: 31-50 Mbps
data to test the eLearning application for loads of 15,000 and
20,000 respectively, using JMeter. Server side resources like                                 Number of users: 20,000
CPU/Memory statistics of database and application servers                                     Bandwidth consumed: 40-50 Mbps
were monitored using AdventNet AppManager. Think time
was considered between every transaction to ensure that
the tests were realistic. In all, two test cycles were executed
by the team.


The performance metrics for the tests focused on end-user response times and resource utilization (CPU/memory). Based
on this, the STAG team identified major suspect areas that could pose performance challenges and resolved them during
the multiple simulated tests conducted on the application. The major suspect areas identified included:

•   High CPU utilization, up to 90%, of the DB server
•   Database deadlocks while the course data was being updated
•   Inconsistencies in the frequency of the course update sent by the application
•   Discrepancies in concurrency during a bulk upload scenario


Based on the test reports, the STAG team made the following recommendations that would help achieve the performance
objectives of the customer.

• A minimum of 31 Mbps and 40 Mbps network lines for 15,000 and 20,000 users respectively
• Web server CPU capacity upgrade to a dual core processor or to a CPU having two processors
• Reduction of file size (GIF, JPG, etc.) and file compression (PDF, PPT, audio, etc.) to improve further the network utilization
of the bandwidth, given that most eLearning course transactions involve a large volume of image downloads



OUTCOME AND VALUE ADDITIONS
The evaluation by the STAG team resulted in the product being certified to handle up to 20,000 users concurrently with no
degradation in performance, which greatly enhanced the deployment confidence of the customer.


STAG’s value addition was not limited to the technical aspects alone, it also included recommending the suitable
hardware/network resources required to support the current and future load and performance requirements.




Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com
Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396


2013 © STAG Software Private Limited. All rights reserved. All trademarks are acknowledged.

Más contenido relacionado

Similar a Pre-deployment Performance Evaluation of Web-based Product

SCQAA-SF Meeting on May 21 2014
SCQAA-SF Meeting on May 21 2014 SCQAA-SF Meeting on May 21 2014
SCQAA-SF Meeting on May 21 2014
Sujit Ghosh
 
SMEUG 2006 - Project IBIS: ERP at UAE University
SMEUG 2006 - Project IBIS: ERP at UAE UniversitySMEUG 2006 - Project IBIS: ERP at UAE University
SMEUG 2006 - Project IBIS: ERP at UAE University
Michael Dobe, Ph.D.
 
Performance Test Slideshow Recent
Performance Test Slideshow RecentPerformance Test Slideshow Recent
Performance Test Slideshow Recent
Future Simmons
 
Performance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N TPerformance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N T
Future Simmons
 

Similar a Pre-deployment Performance Evaluation of Web-based Product (20)

APPLICATION DEVELOPMENT TO CONVERT HETEROGENEOUS INFORMATION INTO PQDIF (POWE...
APPLICATION DEVELOPMENT TO CONVERT HETEROGENEOUS INFORMATION INTO PQDIF (POWE...APPLICATION DEVELOPMENT TO CONVERT HETEROGENEOUS INFORMATION INTO PQDIF (POWE...
APPLICATION DEVELOPMENT TO CONVERT HETEROGENEOUS INFORMATION INTO PQDIF (POWE...
 
Performance Engineering Basics
Performance Engineering BasicsPerformance Engineering Basics
Performance Engineering Basics
 
[En] life sciences software outsourcing services
[En] life sciences software outsourcing services[En] life sciences software outsourcing services
[En] life sciences software outsourcing services
 
Neev Load Testing Services
Neev Load Testing ServicesNeev Load Testing Services
Neev Load Testing Services
 
Increased IT infrastructure effectiveness by 80% with Microsoft system center...
Increased IT infrastructure effectiveness by 80% with Microsoft system center...Increased IT infrastructure effectiveness by 80% with Microsoft system center...
Increased IT infrastructure effectiveness by 80% with Microsoft system center...
 
SCQAA-SF Meeting on May 21 2014
SCQAA-SF Meeting on May 21 2014 SCQAA-SF Meeting on May 21 2014
SCQAA-SF Meeting on May 21 2014
 
Resume
ResumeResume
Resume
 
Performance testing : An Overview
Performance testing : An OverviewPerformance testing : An Overview
Performance testing : An Overview
 
SMEUG 2006 - Project IBIS: ERP at UAE University
SMEUG 2006 - Project IBIS: ERP at UAE UniversitySMEUG 2006 - Project IBIS: ERP at UAE University
SMEUG 2006 - Project IBIS: ERP at UAE University
 
7.3 Years of Experience
7.3 Years of Experience7.3 Years of Experience
7.3 Years of Experience
 
Case study: Performance Testing using Load Runner
Case study: Performance Testing using Load RunnerCase study: Performance Testing using Load Runner
Case study: Performance Testing using Load Runner
 
Resume
ResumeResume
Resume
 
Vivek kumar ray 5 year Java-Webservices-Bigdata
Vivek kumar ray 5 year Java-Webservices-BigdataVivek kumar ray 5 year Java-Webservices-Bigdata
Vivek kumar ray 5 year Java-Webservices-Bigdata
 
Mdk resume
Mdk resumeMdk resume
Mdk resume
 
Performance Test Slideshow Recent
Performance Test Slideshow RecentPerformance Test Slideshow Recent
Performance Test Slideshow Recent
 
Performance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N TPerformance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N T
 
Hewlett Packard Entreprise | Stormrunner load | Game Changer
Hewlett Packard Entreprise | Stormrunner load | Game ChangerHewlett Packard Entreprise | Stormrunner load | Game Changer
Hewlett Packard Entreprise | Stormrunner load | Game Changer
 
MDK_Resume
MDK_ResumeMDK_Resume
MDK_Resume
 
7 Years of Experience
7 Years of Experience7 Years of Experience
7 Years of Experience
 
RamMohan_Testing_8Exp_Resume
RamMohan_Testing_8Exp_ResumeRamMohan_Testing_8Exp_Resume
RamMohan_Testing_8Exp_Resume
 

Más de STAG Software Private Limited

Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
STAG Software Private Limited
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
STAG Software Private Limited
 

Más de STAG Software Private Limited (20)

Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"
 
Choked by technical debt?
Choked by technical debt?Choked by technical debt?
Choked by technical debt?
 
Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
 
Seven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test RapidlySeven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test Rapidly
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing
 
Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 

Último

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Último (20)

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 

Pre-deployment Performance Evaluation of Web-based Product

  • 1. CASE STUDY Pre-deployment Performance Evaluation of Web-based Product STAG certifies an eLearning product ‘deploy-ready’ after extensive LSPS evaluation, enabling our partner to successfully deploy it at the world's largest publicly funded health services organization. Technology - Web-based eLearning LCMS, Microsoft 2003 Server and Cold Fusion 8, Domain - Health Care Web Server with Database Server (SQL Server 2005) Tools - JMeter, AdventNet AppManager CUSTOMER AND PRODUCT BACKGROUND The customer is one of the world’s largest publicly funded health services providers based out of the UK, employing more than 1.7 million people, including 120,000 hospital doctors, 40,000 general practitioners, 400,000 nurses, and 25,000 ambulance staff. The product in question is an eLearning product developed by our UK partner. This tool covers a wide range of training needs and learning competencies to support the implementation and development of an information governance framework within an organization. PROBLEM STATEMENT Our UK partner sought our expertise in LSPS evaluation of the product, as desired by the customer before its deployment at the customer's place, for the following: • Load and performance capability • Ability to withstand concurrent loads • System scalability • Identification of potential bottlenecks (hardware, software, or network) An estimated 37,500 concurrent users were expected at peak usage times.
  • 2. SOLUTION The STAG team created the necessary test environment, developed a scalable automation framework, created a load Number of users: 15,000 profile, developed performance test scripts, and created test Bandwidth consumed: 31-50 Mbps data to test the eLearning application for loads of 15,000 and 20,000 respectively, using JMeter. Server side resources like Number of users: 20,000 CPU/Memory statistics of database and application servers Bandwidth consumed: 40-50 Mbps were monitored using AdventNet AppManager. Think time was considered between every transaction to ensure that the tests were realistic. In all, two test cycles were executed by the team. The performance metrics for the tests focused on end-user response times and resource utilization (CPU/memory). Based on this, the STAG team identified major suspect areas that could pose performance challenges and resolved them during the multiple simulated tests conducted on the application. The major suspect areas identified included: • High CPU utilization, up to 90%, of the DB server • Database deadlocks while the course data was being updated • Inconsistencies in the frequency of the course update sent by the application • Discrepancies in concurrency during a bulk upload scenario Based on the test reports, the STAG team made the following recommendations that would help achieve the performance objectives of the customer. • A minimum of 31 Mbps and 40 Mbps network lines for 15,000 and 20,000 users respectively • Web server CPU capacity upgrade to a dual core processor or to a CPU having two processors • Reduction of file size (GIF, JPG, etc.) and file compression (PDF, PPT, audio, etc.) to improve further the network utilization of the bandwidth, given that most eLearning course transactions involve a large volume of image downloads OUTCOME AND VALUE ADDITIONS The evaluation by the STAG team resulted in the product being certified to handle up to 20,000 users concurrently with no degradation in performance, which greatly enhanced the deployment confidence of the customer. STAG’s value addition was not limited to the technical aspects alone, it also included recommending the suitable hardware/network resources required to support the current and future load and performance requirements. Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396 2013 © STAG Software Private Limited. All rights reserved. All trademarks are acknowledged.