7. Problem Statement
• Problem Statement :
• No Automation or lack of efficiencies
• Less frequent production deployment : twice a month at best
• High defect escape rate
9. Sauce Labs Partnership
• Key Benefits
• Lets us focus on building automation products to increase frequency of deployments
• Faster availability of new devices and browsers
• One setup and one access point for all teams in the organization
• Key Metrics
• 50K+ tests executed per day and growing
• 1150 OS/Browser combinations
• Devices and Emulators
* Exclusive access to 81 devices in private cloud
Real Devices Emulators
303* 172
10. Impact
ENABLES
MASSIVELY PARALLEL
RELIABLE & DETERMINISTIC
ACTIONABLE DASHBOARDS
Ability to process hundreds of test cases
simultaneously to speed up overall
completion of a test suite
Smart Retry feature and mocking guard
against flaky test
Real-time and trending metrics provide
valuable insights to help debug/troubleshoot
quality issues
Adoption: 74 teams Test Cases: 13.2K
Executions: 14.5 million+ tests
Multi-Tenant Platform supporting
8 product organizations
Effort saving 900K + hours ~ 425
man years
Good morning everyone
Introduce myself
We are jump starting a 5 part series to showcase our Test Armada quality automation tooling suite.
Today is part 1 of the series, where we will re-introduce Test Armada to Walmart.
This talk will lay the foundation for the remainder of the series scheduled over the next couple of months
Original Message:End to end test platform to cover functional and performance testing for web, native, and backend services in different environments with reporting capabilities.
Let’s take a look at what TA offers…
Let’s take a look at the name. Armada is a fleet of warships used in a time of battle.
As part of our re-branding efforts, we applied this meaning to Test Armada, where the Test Armada Fleets would be the supporting tools to help battled against operational efficiencies.
We provide functional and performance testing TDKs for web, native, and backend services
A data insights platform to review runtime and trending quality automation metrics for your test runs.
And mocking framework to help remove dependencies on external services, seed data management, and prototype needs
In the future we are looking at supporting two additional Fleets: Security and ADA
Pranav will go into a more details of our new and improve Test Armada tool suite shortly.
How does TA fit into the overall CI/CD eco-system here at Walmart?
Original Message:End to end test platform to cover functional and performance testing for web, native, and backend services in different environments with reporting capabilities.