SlideShare una empresa de Scribd logo
1 de 29
Descargar para leer sin conexión
© 2013 Maveric Systems Limited
Critical Functionality
Testing (CFT)
© 2013 Maveric Systems Limited 2
▸ Introduction – CFT
▸ Need for CFT
▸ CFT Framework
▸ Benefits of CFT
▸ Advantages of CFT over Traditional Approach
▸ Case Study
Presentation Outline
© 2013 Maveric Systems Limited 3
▸ A pre-UAT round that quantifies and qualifies the application under
test for User Acceptance Testing (UAT)
▸ Test evolution – from our experiences across multiple engagements
▸ Is a strategy derived from our Risk Based Testing Framework
▸ Testing of Business Critical Functionalities across modules with
emphasis on Go-live functionalities
▸ CFT will not replace UAT, it only ensures a better UAT and helps
meeting overall project timelines
▸ CFT – cannot pick all showstoppers issues, it only indicates what
trouble may lie ahead in UAT
▸ Can cover about 20-30% of cases planned for UAT
Introduction – Critical
Functionality Testing
© 2013 Maveric Systems Limited 4
▸ Assesses the stability of the application
▸ Quantifies the percent of critical functions which have defects
across modules
▸ Irons out differences if any on functionalities with the business
▸ Missing or wrong parameter set-ups can be identified before UAT
thereby negating unnecessary re-running of scripts in UAT rounds,
especially batch dependent cases due to missing set-ups
▸ Interfaces – understanding the compatibility of the application with
3rd party interfaces
Need for CFT
© 2013 Maveric Systems Limited 5
Plan Specify Build Test Implement
Application Lifecycle Cost
International Software Benchmarking
Standard Group (Data Sample 404 projects)
www.isbsg.org
Real time
Industry
Maveric Approach
5% 23% 41% 21% 9%
© 2013 Maveric Systems Limited 6
Specify Define Design Code Test Deploy Production
Early Detection StrategyNoofdefects
(Increasing) time and cost to fix defects
Time & Cost
Prevention
strategy
Traditional detection
strategy
Early detection
strategy (CFT)
© 2013 Maveric Systems Limited 7
Best Practices – CFT
Framework
CFT framework
Critical
functional
scenarios
Parameter
set-ups
Interfaces
connectivity
and
compatibility
Batch
processes
Test bed
readiness and
database sync
up across all
systems
© 2013 Maveric Systems Limited 8
Best Practices – CFT
Framework
CFT framework
Test bed
readiness and
database sync
up across all
systems
Critical
functional
scenarios
Parameter
set-ups
Interfaces
connectivity
and
compatibility
Batch
processes
© 2013 Maveric Systems Limited 9
▸ Transactions with high financial impact
▸ Transactions involving critical functional flow
▸ Batch dependent scenarios
▸ Focused discussions and meetings with business to
identify critical functional points
▸ Identifying any changes to Business Requirements at an
early stage thereby avoiding the need to raise CRs
Critical Functional Scenarios –
Rationale
© 2013 Maveric Systems Limited 10
▸ Compatibility of interfaces with the core system
▸ Communication between different 3rd party interfaces
▸ Helps in optimizing the Run Plan covering only
functionality of interfaces which are test ready for UAT
Interface Connectivity and
Compatibility
© 2013 Maveric Systems Limited 11
▸ Batch critical reports – MIS reports
» Financial reports
» Regulatory and compliance reports
▸ Focuses more on the data generated in the report than cosmetic
ones like alignment etc.
▸ Example: Premium collection report
» Claim process report
Reports
© 2013 Maveric Systems Limited 12
▸ Ensures all parameter set-up are completed before starting UAT
▸ Special focus on escalations on authorizations and approvals
▸ Negates unnecessary need to re-run cases due to missing set-up
Set-up Parameters
© 2013 Maveric Systems Limited 13
▸ End of day and end of month process are run
▸ End of year process is run by moving dates/defining holidays
▸ Ensures there are no hiccups in execution of test cases as per the
Run Plan during UAT
▸ Defects in batch process adversely effect the schedule of testing,
CFT helps in negating such high risks entering into UAT
Batch Processes
© 2013 Maveric Systems Limited 14
▸ Ensures different databases are in sync with the core
▸ Access to different databases for migrated test data
▸ Gives an idea on the quality of migrated data
Test Bed Readiness and
Database Sync-up
© 2013 Maveric Systems Limited 15
Entry criteria for CFT – Done when SIT is complete and signed off
▸ Business critical functional points have been identified after discussion and
sign-off by Business Line Managers
CFT exit criteria
▸ 70% of the Critical Functions should pass
▸ Number of showstopper defects to be less than 20%
▸ All interfaces should be up and running
▸ All databases should be made in Sync
▸ EOD should be successful
CFT Entry and Exit
© 2013 Maveric Systems Limited 16
Insurance
▸ Customer Creation (CIF)
▸ Opening of Customer & Loan Accounts
▸ Cash Deposits and Withdrawals
▸ Fund Transfers
▸ End of Day Processing
▸ Customer Creation
▸ New Business
▸ Underwriting and Rating Factors
▸ Premium Computation
▸ Mid Term Endorsements – Financial
▸ Mid Term Endorsements – Non Financial
▸ Collections and Refunds
▸ Claim Handling
▸ Renewals
▸ Reports and Accounting
▸ Batch Processing
Examples
© 2013 Maveric Systems Limited 17
Observations and Risk
Classification
Key process/activities Risk classification Potential risk
Critical functional scenarios
Under control, however non conformance
by business users can lead to risk
Test environment readiness
Missing set-ups and a sync databases may
lead to re-running cases thereby increasing
timelines and effort
Test readiness of interfaces
Knowing incompatibility or non-availability
of major functionality during UAT may cause
major set back to timelines
Reports
Non-availability of compliance or regulatory
reports during UAT impacts Go-live date
Batch process
Abnormal timelines or showstopper here will
affect the entire testing schedule
Low Risk
Medium Risk
High Risk
© 2013 Maveric Systems Limited 18
▸ 70% of the critical functions should pass
▸ Number of showstopper defects to be less than 20%
▸ All interfaces should be up and running
▸ All databases should be made in sync
▸ EOD should be successful
CFT Exit – UAT Entry
© 2013 Maveric Systems Limited 19
▸ Reduce costs – Identifying defects at an early stage reduces costs and also only
50-60% of the testing team is present onsite for CFT
▸ CFT design is done parallel with UAT design hence separate effort is not required
▸ Change requests on critical functions if any can be identified at an early stage by
the business
▸ Reduces the effort of business users during UAT
▸ Same design pack can be re-used with minor modifications to do a quick sanity
check after releases or enhancements
▸ Helps the business and also the testing team to understand the differences
between legacy and the new system
Benefits of CFT for Business
© 2013 Maveric Systems Limited 20
▸ Identifying most of the business critical defects at an early stage
gives the development team more time to fix
▸ Helps the development team to reassess priorities and areas to
focus on as the development team is not bombarded with cosmetic
and minor defects earlier
Benefits of CFT for the
Developers’
© 2013 Maveric Systems Limited 21
▸ Gives a metrics based report on defects thereby helping to identify
areas to focus on during UAT
▸ Helps project management team identifying areas to focus-on and
reschedule timelines if necessary
▸ Exactly identify when to start and bring in the full team for UAT
Benefits of CFT for the
Testing Team
© 2013 Maveric Systems Limited 22
▸ Covers both critical and non-critical
transactions hence priorities may get
misplaced on non-critical functions
▸ Critical business defects may be found
at the end of the round 1 which will
take time to fix
▸ Defects on critical function may get
overlooked due to overwhelming
number of defects
▸ May need to stop UAT mid-way due to
large showstoppers and critical defects
thereby wasting time and money
Advantage CFT
Traditional Approach CFT
▸ Focus on critical functions from a very
early stage of the testing lifecycle
▸ Helps the business to know the
percent and the status of defects on
Go-Live critical functions right from the
start
▸ Cuts down on time spent on non-
critical functions at the start of the
testing assignment
▸ Focused discussions and meeting with
business to exactly identify the critical
functions
© 2013 Maveric Systems Limited 23
CFT – Where Does it Fit in the
Testing Calendar
CFT runs parallel
to UAT Design
and CFT uses
30% of UAT
design
CFT ensures a high
quality UAT is met
CFT sets entry criteria
for UAT Entry
© 2013 Maveric Systems Limited 24
Case Study
▸ A leading commercial insurance
organization in the Middle East was
migrating from a legacy core insurance
system to a new core insurance
solution with specific business
customization and enhancements
▸ The core-insurance solution was to be
implemented phase-wise (in 3 phases)
across 73 branches through out the
country
▸ The phase I rollout was being planned
with aggressive timelines as the
insurance company had to do catch-up
with its competitors in converting to
new technology solution which was of
paramount importance to sustain its
market share
Client Context Challenges
▸ Documentation was very minimal and
not updated
▸ Frequent changes to requirements
▸ Need to collaborate with the insurance
company on one side, and the
application vendor’s on the other side
with stiff timelines
▸ An application architecture that
required extensive batch runs for EODs
etc.
▸ Domain competence in core insurance
solution to address country specific
requirements and regulations
especially for reports (compliance)
▸ An approach to ensure production
quality at the same time keeping cost
and timelines at a tight leach
© 2013 Maveric Systems Limited 25
▸ Maveric adopted CFT based testing approach to meet timelines
at the same time ensuring product quality
▸ Only 60% of the team was positioned onsite to cut down the
project cost
▸ The team comprised of domain experts who organized daily
meetings with Business Line Managers to get clear cut
understanding of the customizations
▸ Weekly two meetings were conducted involving both the
development team and the Business Line Managers to ensure that
everyone was in the same page with the respect to the functional
specs of the customizations
▸ Minutes of the meeting were documented and circulated
to all the parties involved and were used as BRS documents
for reference
Maveric Solution – CFT
© 2013 Maveric Systems Limited 26
▸ The end of day was taking 12hrs to complete during CFT, this was immediately
worked upon and brought to 5hrs during UAT Round 1. Further, analysis were
done by the development team and fixing was too complex and took time, but
at the end of Round 2, it was brought down to 1 hour 30 minutes
▸ Due to extensive customization the solution had around 40% defects in business
critical functionalities
▸ Project Management company delayed the start of UAT by 10 days to give more
time for developers’ to fix the critical defects. The remaining of the test team
was not brought board during this time thereby reducing the cost
▸ The development team suggested work around solutions for few defects as the
fix was complex and required more time. Those fixes as promised were delivered
for Round 2
Maveric Solution – CFT (Cont’d)
© 2013 Maveric Systems Limited 27
▸ Gap Analysis – Identified that only five interfaces out of
the 7 were test ready
▸ Priorities were reassessed and only 5 interfaces namely
ATM, I-Score, CBE Files Electronic Cheque Clearing and
Covered Visa were taken up for Phase I
▸ Reports – One resource from Maveric was dedicated to
test CBE reports in CFT
Maveric Solution – CFT (Cont’d)
© 2013 Maveric Systems Limited 28
▸ To Introduce Early Defect Detection (EDD) Strategy,
Essential Start -Stop- Continue Strategies are:
▸ CFT is a Win-Win strategy for the client, development teams and
also for testing team to mutually ensure a quality solution goes into
production within the timelines planned
Conclusion
Start Stop Continue
Planning ahead and release
application for EDD early
Introducing last minute
requirement changes
Focus on Good Quality UAT
Engage specialized testing
partners and build high toll gate
for UAT Entry
Defining poor UAT Entry
Criteria's
To reject poorly built application
Plan for CFT to be included in
the overall project
implementation Plan
Don’t engage Users till CFT toll
gates are met
Engage Users in UAT and build
lifecycle cases
© 2013 Maveric Systems Limited
Thank You

Más contenido relacionado

Similar a Critical functionality testing

Essential building blocks of a lean and efficient test process
Essential building blocks of a lean and efficient test processEssential building blocks of a lean and efficient test process
Essential building blocks of a lean and efficient test processMaveric Systems
 
Requirements Practice - Maveric Systems
Requirements Practice - Maveric SystemsRequirements Practice - Maveric Systems
Requirements Practice - Maveric SystemsMaveric Systems
 
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...Agile Testing Alliance
 
Campus recruitment 2013
Campus recruitment   2013Campus recruitment   2013
Campus recruitment 2013Somnath Manna
 
Presentation maintenence management
Presentation maintenence managementPresentation maintenence management
Presentation maintenence managementVaisakh S Babu
 
UAT for a Major US Banking Conglomerate
UAT for a Major US Banking ConglomerateUAT for a Major US Banking Conglomerate
UAT for a Major US Banking ConglomerateThinksoft Global
 
Cloud – A strategic opportunity
Cloud – A strategic opportunityCloud – A strategic opportunity
Cloud – A strategic opportunityMicrosoft
 
Traf testing requirement analysis framework
Traf testing requirement analysis frameworkTraf testing requirement analysis framework
Traf testing requirement analysis frameworkTarun Aarya
 
Top Ten Superstream Learnings from 2014
Top Ten Superstream Learnings from 2014Top Ten Superstream Learnings from 2014
Top Ten Superstream Learnings from 2014QMV Super Solutions
 
Exploring the Challenges of Implementing and Sustaining Cross-Platform NAS Ca...
Exploring the Challenges of Implementing and Sustaining Cross-Platform NAS Ca...Exploring the Challenges of Implementing and Sustaining Cross-Platform NAS Ca...
Exploring the Challenges of Implementing and Sustaining Cross-Platform NAS Ca...EvansIncorporated
 
How to Select High Impact Use Cases to Drive a Successful Network Automation ...
How to Select High Impact Use Cases to Drive a Successful Network Automation ...How to Select High Impact Use Cases to Drive a Successful Network Automation ...
How to Select High Impact Use Cases to Drive a Successful Network Automation ...Itential
 
ProAct Yard Management Solution - Potential Business Benefits
ProAct Yard Management Solution - Potential Business BenefitsProAct Yard Management Solution - Potential Business Benefits
ProAct Yard Management Solution - Potential Business BenefitsProAct International
 
EXTENT-2016: Test Automation and Agile Testing
EXTENT-2016: Test Automation and Agile TestingEXTENT-2016: Test Automation and Agile Testing
EXTENT-2016: Test Automation and Agile TestingIosif Itkin
 
EXL White Paper - Why PAS Implementations Fail
EXL White Paper - Why PAS Implementations FailEXL White Paper - Why PAS Implementations Fail
EXL White Paper - Why PAS Implementations FailAditya Chaturvedi
 
SPONSORED CONTENT: Taking CMMC Seriously - What Is The Cost Of Compliance?
SPONSORED CONTENT: Taking CMMC Seriously - What Is The Cost Of Compliance?   SPONSORED CONTENT: Taking CMMC Seriously - What Is The Cost Of Compliance?
SPONSORED CONTENT: Taking CMMC Seriously - What Is The Cost Of Compliance? JSchaus & Associates
 
Independent verification & validation presented by Maneat v02
Independent verification & validation presented by Maneat v02Independent verification & validation presented by Maneat v02
Independent verification & validation presented by Maneat v02Dr. Pierpaolo Mangeruga
 
Lean for Competitive Advantage and Customer Delight
Lean for Competitive Advantage and Customer DelightLean for Competitive Advantage and Customer Delight
Lean for Competitive Advantage and Customer DelightLean India Summit
 
Performance Testing
Performance TestingPerformance Testing
Performance TestingvodQA
 
Tips for automation project final
Tips for automation project finalTips for automation project final
Tips for automation project finalMassimo Cappello
 

Similar a Critical functionality testing (20)

Essential building blocks of a lean and efficient test process
Essential building blocks of a lean and efficient test processEssential building blocks of a lean and efficient test process
Essential building blocks of a lean and efficient test process
 
Requirements Practice - Maveric Systems
Requirements Practice - Maveric SystemsRequirements Practice - Maveric Systems
Requirements Practice - Maveric Systems
 
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
 
Campus recruitment 2013
Campus recruitment   2013Campus recruitment   2013
Campus recruitment 2013
 
Presentation maintenence management
Presentation maintenence managementPresentation maintenence management
Presentation maintenence management
 
UAT for a Major US Banking Conglomerate
UAT for a Major US Banking ConglomerateUAT for a Major US Banking Conglomerate
UAT for a Major US Banking Conglomerate
 
Cloud – A strategic opportunity
Cloud – A strategic opportunityCloud – A strategic opportunity
Cloud – A strategic opportunity
 
Traf testing requirement analysis framework
Traf testing requirement analysis frameworkTraf testing requirement analysis framework
Traf testing requirement analysis framework
 
Top Ten Superstream Learnings from 2014
Top Ten Superstream Learnings from 2014Top Ten Superstream Learnings from 2014
Top Ten Superstream Learnings from 2014
 
Exploring the Challenges of Implementing and Sustaining Cross-Platform NAS Ca...
Exploring the Challenges of Implementing and Sustaining Cross-Platform NAS Ca...Exploring the Challenges of Implementing and Sustaining Cross-Platform NAS Ca...
Exploring the Challenges of Implementing and Sustaining Cross-Platform NAS Ca...
 
How to Select High Impact Use Cases to Drive a Successful Network Automation ...
How to Select High Impact Use Cases to Drive a Successful Network Automation ...How to Select High Impact Use Cases to Drive a Successful Network Automation ...
How to Select High Impact Use Cases to Drive a Successful Network Automation ...
 
ProAct Yard Management Solution - Potential Business Benefits
ProAct Yard Management Solution - Potential Business BenefitsProAct Yard Management Solution - Potential Business Benefits
ProAct Yard Management Solution - Potential Business Benefits
 
EXTENT-2016: Test Automation and Agile Testing
EXTENT-2016: Test Automation and Agile TestingEXTENT-2016: Test Automation and Agile Testing
EXTENT-2016: Test Automation and Agile Testing
 
EXL White Paper - Why PAS Implementations Fail
EXL White Paper - Why PAS Implementations FailEXL White Paper - Why PAS Implementations Fail
EXL White Paper - Why PAS Implementations Fail
 
Industrialization of testing
Industrialization of testing Industrialization of testing
Industrialization of testing
 
SPONSORED CONTENT: Taking CMMC Seriously - What Is The Cost Of Compliance?
SPONSORED CONTENT: Taking CMMC Seriously - What Is The Cost Of Compliance?   SPONSORED CONTENT: Taking CMMC Seriously - What Is The Cost Of Compliance?
SPONSORED CONTENT: Taking CMMC Seriously - What Is The Cost Of Compliance?
 
Independent verification & validation presented by Maneat v02
Independent verification & validation presented by Maneat v02Independent verification & validation presented by Maneat v02
Independent verification & validation presented by Maneat v02
 
Lean for Competitive Advantage and Customer Delight
Lean for Competitive Advantage and Customer DelightLean for Competitive Advantage and Customer Delight
Lean for Competitive Advantage and Customer Delight
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
 
Tips for automation project final
Tips for automation project finalTips for automation project final
Tips for automation project final
 

Más de Maveric Systems

Standards models for setting up a robust t co-e
Standards models for setting up a robust t co-eStandards models for setting up a robust t co-e
Standards models for setting up a robust t co-eMaveric Systems
 
Transformation Assurance
Transformation AssuranceTransformation Assurance
Transformation AssuranceMaveric Systems
 
Standards / Models for Setting Up a Robust TCoE - Maveric Systems
Standards / Models for Setting Up a Robust TCoE - Maveric SystemsStandards / Models for Setting Up a Robust TCoE - Maveric Systems
Standards / Models for Setting Up a Robust TCoE - Maveric SystemsMaveric Systems
 
Automation of Release and Deployment Management - Maveric
Automation of Release and Deployment Management - MavericAutomation of Release and Deployment Management - Maveric
Automation of Release and Deployment Management - MavericMaveric Systems
 
Importance of program health checks
Importance of program health checksImportance of program health checks
Importance of program health checksMaveric Systems
 
Critical success factors for successful requirements manangement
Critical success factors for successful requirements manangementCritical success factors for successful requirements manangement
Critical success factors for successful requirements manangementMaveric Systems
 
Importance of requirement assurance in product selection
Importance of requirement assurance in product selectionImportance of requirement assurance in product selection
Importance of requirement assurance in product selectionMaveric Systems
 
Importance of early project requirements definition
Importance of early project requirements definitionImportance of early project requirements definition
Importance of early project requirements definitionMaveric Systems
 

Más de Maveric Systems (10)

Maveric Systems
Maveric Systems Maveric Systems
Maveric Systems
 
Standards models for setting up a robust t co-e
Standards models for setting up a robust t co-eStandards models for setting up a robust t co-e
Standards models for setting up a robust t co-e
 
Assurance
AssuranceAssurance
Assurance
 
Transformation Assurance
Transformation AssuranceTransformation Assurance
Transformation Assurance
 
Standards / Models for Setting Up a Robust TCoE - Maveric Systems
Standards / Models for Setting Up a Robust TCoE - Maveric SystemsStandards / Models for Setting Up a Robust TCoE - Maveric Systems
Standards / Models for Setting Up a Robust TCoE - Maveric Systems
 
Automation of Release and Deployment Management - Maveric
Automation of Release and Deployment Management - MavericAutomation of Release and Deployment Management - Maveric
Automation of Release and Deployment Management - Maveric
 
Importance of program health checks
Importance of program health checksImportance of program health checks
Importance of program health checks
 
Critical success factors for successful requirements manangement
Critical success factors for successful requirements manangementCritical success factors for successful requirements manangement
Critical success factors for successful requirements manangement
 
Importance of requirement assurance in product selection
Importance of requirement assurance in product selectionImportance of requirement assurance in product selection
Importance of requirement assurance in product selection
 
Importance of early project requirements definition
Importance of early project requirements definitionImportance of early project requirements definition
Importance of early project requirements definition
 

Último

UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...Daniel Zivkovic
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Alexander Turgeon
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
100+ ChatGPT Prompts for SEO Optimization
100+ ChatGPT Prompts for SEO Optimization100+ ChatGPT Prompts for SEO Optimization
100+ ChatGPT Prompts for SEO Optimizationarrow10202532yuvraj
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideIEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideHironori Washizaki
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5DianaGray10
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 

Último (20)

UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
100+ ChatGPT Prompts for SEO Optimization
100+ ChatGPT Prompts for SEO Optimization100+ ChatGPT Prompts for SEO Optimization
100+ ChatGPT Prompts for SEO Optimization
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideIEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 

Critical functionality testing

  • 1. © 2013 Maveric Systems Limited Critical Functionality Testing (CFT)
  • 2. © 2013 Maveric Systems Limited 2 ▸ Introduction – CFT ▸ Need for CFT ▸ CFT Framework ▸ Benefits of CFT ▸ Advantages of CFT over Traditional Approach ▸ Case Study Presentation Outline
  • 3. © 2013 Maveric Systems Limited 3 ▸ A pre-UAT round that quantifies and qualifies the application under test for User Acceptance Testing (UAT) ▸ Test evolution – from our experiences across multiple engagements ▸ Is a strategy derived from our Risk Based Testing Framework ▸ Testing of Business Critical Functionalities across modules with emphasis on Go-live functionalities ▸ CFT will not replace UAT, it only ensures a better UAT and helps meeting overall project timelines ▸ CFT – cannot pick all showstoppers issues, it only indicates what trouble may lie ahead in UAT ▸ Can cover about 20-30% of cases planned for UAT Introduction – Critical Functionality Testing
  • 4. © 2013 Maveric Systems Limited 4 ▸ Assesses the stability of the application ▸ Quantifies the percent of critical functions which have defects across modules ▸ Irons out differences if any on functionalities with the business ▸ Missing or wrong parameter set-ups can be identified before UAT thereby negating unnecessary re-running of scripts in UAT rounds, especially batch dependent cases due to missing set-ups ▸ Interfaces – understanding the compatibility of the application with 3rd party interfaces Need for CFT
  • 5. © 2013 Maveric Systems Limited 5 Plan Specify Build Test Implement Application Lifecycle Cost International Software Benchmarking Standard Group (Data Sample 404 projects) www.isbsg.org Real time Industry Maveric Approach 5% 23% 41% 21% 9%
  • 6. © 2013 Maveric Systems Limited 6 Specify Define Design Code Test Deploy Production Early Detection StrategyNoofdefects (Increasing) time and cost to fix defects Time & Cost Prevention strategy Traditional detection strategy Early detection strategy (CFT)
  • 7. © 2013 Maveric Systems Limited 7 Best Practices – CFT Framework CFT framework Critical functional scenarios Parameter set-ups Interfaces connectivity and compatibility Batch processes Test bed readiness and database sync up across all systems
  • 8. © 2013 Maveric Systems Limited 8 Best Practices – CFT Framework CFT framework Test bed readiness and database sync up across all systems Critical functional scenarios Parameter set-ups Interfaces connectivity and compatibility Batch processes
  • 9. © 2013 Maveric Systems Limited 9 ▸ Transactions with high financial impact ▸ Transactions involving critical functional flow ▸ Batch dependent scenarios ▸ Focused discussions and meetings with business to identify critical functional points ▸ Identifying any changes to Business Requirements at an early stage thereby avoiding the need to raise CRs Critical Functional Scenarios – Rationale
  • 10. © 2013 Maveric Systems Limited 10 ▸ Compatibility of interfaces with the core system ▸ Communication between different 3rd party interfaces ▸ Helps in optimizing the Run Plan covering only functionality of interfaces which are test ready for UAT Interface Connectivity and Compatibility
  • 11. © 2013 Maveric Systems Limited 11 ▸ Batch critical reports – MIS reports » Financial reports » Regulatory and compliance reports ▸ Focuses more on the data generated in the report than cosmetic ones like alignment etc. ▸ Example: Premium collection report » Claim process report Reports
  • 12. © 2013 Maveric Systems Limited 12 ▸ Ensures all parameter set-up are completed before starting UAT ▸ Special focus on escalations on authorizations and approvals ▸ Negates unnecessary need to re-run cases due to missing set-up Set-up Parameters
  • 13. © 2013 Maveric Systems Limited 13 ▸ End of day and end of month process are run ▸ End of year process is run by moving dates/defining holidays ▸ Ensures there are no hiccups in execution of test cases as per the Run Plan during UAT ▸ Defects in batch process adversely effect the schedule of testing, CFT helps in negating such high risks entering into UAT Batch Processes
  • 14. © 2013 Maveric Systems Limited 14 ▸ Ensures different databases are in sync with the core ▸ Access to different databases for migrated test data ▸ Gives an idea on the quality of migrated data Test Bed Readiness and Database Sync-up
  • 15. © 2013 Maveric Systems Limited 15 Entry criteria for CFT – Done when SIT is complete and signed off ▸ Business critical functional points have been identified after discussion and sign-off by Business Line Managers CFT exit criteria ▸ 70% of the Critical Functions should pass ▸ Number of showstopper defects to be less than 20% ▸ All interfaces should be up and running ▸ All databases should be made in Sync ▸ EOD should be successful CFT Entry and Exit
  • 16. © 2013 Maveric Systems Limited 16 Insurance ▸ Customer Creation (CIF) ▸ Opening of Customer & Loan Accounts ▸ Cash Deposits and Withdrawals ▸ Fund Transfers ▸ End of Day Processing ▸ Customer Creation ▸ New Business ▸ Underwriting and Rating Factors ▸ Premium Computation ▸ Mid Term Endorsements – Financial ▸ Mid Term Endorsements – Non Financial ▸ Collections and Refunds ▸ Claim Handling ▸ Renewals ▸ Reports and Accounting ▸ Batch Processing Examples
  • 17. © 2013 Maveric Systems Limited 17 Observations and Risk Classification Key process/activities Risk classification Potential risk Critical functional scenarios Under control, however non conformance by business users can lead to risk Test environment readiness Missing set-ups and a sync databases may lead to re-running cases thereby increasing timelines and effort Test readiness of interfaces Knowing incompatibility or non-availability of major functionality during UAT may cause major set back to timelines Reports Non-availability of compliance or regulatory reports during UAT impacts Go-live date Batch process Abnormal timelines or showstopper here will affect the entire testing schedule Low Risk Medium Risk High Risk
  • 18. © 2013 Maveric Systems Limited 18 ▸ 70% of the critical functions should pass ▸ Number of showstopper defects to be less than 20% ▸ All interfaces should be up and running ▸ All databases should be made in sync ▸ EOD should be successful CFT Exit – UAT Entry
  • 19. © 2013 Maveric Systems Limited 19 ▸ Reduce costs – Identifying defects at an early stage reduces costs and also only 50-60% of the testing team is present onsite for CFT ▸ CFT design is done parallel with UAT design hence separate effort is not required ▸ Change requests on critical functions if any can be identified at an early stage by the business ▸ Reduces the effort of business users during UAT ▸ Same design pack can be re-used with minor modifications to do a quick sanity check after releases or enhancements ▸ Helps the business and also the testing team to understand the differences between legacy and the new system Benefits of CFT for Business
  • 20. © 2013 Maveric Systems Limited 20 ▸ Identifying most of the business critical defects at an early stage gives the development team more time to fix ▸ Helps the development team to reassess priorities and areas to focus on as the development team is not bombarded with cosmetic and minor defects earlier Benefits of CFT for the Developers’
  • 21. © 2013 Maveric Systems Limited 21 ▸ Gives a metrics based report on defects thereby helping to identify areas to focus on during UAT ▸ Helps project management team identifying areas to focus-on and reschedule timelines if necessary ▸ Exactly identify when to start and bring in the full team for UAT Benefits of CFT for the Testing Team
  • 22. © 2013 Maveric Systems Limited 22 ▸ Covers both critical and non-critical transactions hence priorities may get misplaced on non-critical functions ▸ Critical business defects may be found at the end of the round 1 which will take time to fix ▸ Defects on critical function may get overlooked due to overwhelming number of defects ▸ May need to stop UAT mid-way due to large showstoppers and critical defects thereby wasting time and money Advantage CFT Traditional Approach CFT ▸ Focus on critical functions from a very early stage of the testing lifecycle ▸ Helps the business to know the percent and the status of defects on Go-Live critical functions right from the start ▸ Cuts down on time spent on non- critical functions at the start of the testing assignment ▸ Focused discussions and meeting with business to exactly identify the critical functions
  • 23. © 2013 Maveric Systems Limited 23 CFT – Where Does it Fit in the Testing Calendar CFT runs parallel to UAT Design and CFT uses 30% of UAT design CFT ensures a high quality UAT is met CFT sets entry criteria for UAT Entry
  • 24. © 2013 Maveric Systems Limited 24 Case Study ▸ A leading commercial insurance organization in the Middle East was migrating from a legacy core insurance system to a new core insurance solution with specific business customization and enhancements ▸ The core-insurance solution was to be implemented phase-wise (in 3 phases) across 73 branches through out the country ▸ The phase I rollout was being planned with aggressive timelines as the insurance company had to do catch-up with its competitors in converting to new technology solution which was of paramount importance to sustain its market share Client Context Challenges ▸ Documentation was very minimal and not updated ▸ Frequent changes to requirements ▸ Need to collaborate with the insurance company on one side, and the application vendor’s on the other side with stiff timelines ▸ An application architecture that required extensive batch runs for EODs etc. ▸ Domain competence in core insurance solution to address country specific requirements and regulations especially for reports (compliance) ▸ An approach to ensure production quality at the same time keeping cost and timelines at a tight leach
  • 25. © 2013 Maveric Systems Limited 25 ▸ Maveric adopted CFT based testing approach to meet timelines at the same time ensuring product quality ▸ Only 60% of the team was positioned onsite to cut down the project cost ▸ The team comprised of domain experts who organized daily meetings with Business Line Managers to get clear cut understanding of the customizations ▸ Weekly two meetings were conducted involving both the development team and the Business Line Managers to ensure that everyone was in the same page with the respect to the functional specs of the customizations ▸ Minutes of the meeting were documented and circulated to all the parties involved and were used as BRS documents for reference Maveric Solution – CFT
  • 26. © 2013 Maveric Systems Limited 26 ▸ The end of day was taking 12hrs to complete during CFT, this was immediately worked upon and brought to 5hrs during UAT Round 1. Further, analysis were done by the development team and fixing was too complex and took time, but at the end of Round 2, it was brought down to 1 hour 30 minutes ▸ Due to extensive customization the solution had around 40% defects in business critical functionalities ▸ Project Management company delayed the start of UAT by 10 days to give more time for developers’ to fix the critical defects. The remaining of the test team was not brought board during this time thereby reducing the cost ▸ The development team suggested work around solutions for few defects as the fix was complex and required more time. Those fixes as promised were delivered for Round 2 Maveric Solution – CFT (Cont’d)
  • 27. © 2013 Maveric Systems Limited 27 ▸ Gap Analysis – Identified that only five interfaces out of the 7 were test ready ▸ Priorities were reassessed and only 5 interfaces namely ATM, I-Score, CBE Files Electronic Cheque Clearing and Covered Visa were taken up for Phase I ▸ Reports – One resource from Maveric was dedicated to test CBE reports in CFT Maveric Solution – CFT (Cont’d)
  • 28. © 2013 Maveric Systems Limited 28 ▸ To Introduce Early Defect Detection (EDD) Strategy, Essential Start -Stop- Continue Strategies are: ▸ CFT is a Win-Win strategy for the client, development teams and also for testing team to mutually ensure a quality solution goes into production within the timelines planned Conclusion Start Stop Continue Planning ahead and release application for EDD early Introducing last minute requirement changes Focus on Good Quality UAT Engage specialized testing partners and build high toll gate for UAT Entry Defining poor UAT Entry Criteria's To reject poorly built application Plan for CFT to be included in the overall project implementation Plan Don’t engage Users till CFT toll gates are met Engage Users in UAT and build lifecycle cases
  • 29. © 2013 Maveric Systems Limited Thank You