SlideShare a Scribd company logo
1 of 13
QA & You
Agenda
• Introduction
• What are some of the challenges we are
facing
• How did we solve these challenges
• Q & A / Feedback
Introduction
• My Name: Jon Robinson (@jumpmancol)
• What I Do: QA Lead for Scripps WCM
Platform
• My Background: Started as a consultant,
and have worked for both Fortune 500
companies as well as small startups.
Wide range of industry experience;
Banking, Financial Services, Insurance,
Retail, Media
Project Overview
• Project has roughly ~60 people involved on a daily
basis
• ~40 are directly related to development or QA
• ~20 are Project/Program level
• Mass CHAOS!!!!!!!
Developer Challenges
• Very, very aggressive pace
• QA team is a separate unit
• Developers often work in isolation
• Need precise steps to recreate issues that QA finds
QA Challenges
• Developers do not typically develop with QA in mind
• Dev teams have a tendency to say “Well it works on
my system”
• A lot of valuable testing time is taken up in writing up
the steps the dev teams need to recreate
Leads Challenges
• The back and forth nature of issues bouncing
between teams is a giant time suck
• A whole lot of “Hurry up and wait” happening
• Accurately determining the readiness of a feature
can be difficult
The Squad Approach
• A team of 2-3 people
• Typically 2 developers, and 1 QA
• Work in a pair programming approach
• No longer separate Dev & QA designations, but
rather a single Delivery team
• Much more SCRUM-like
• Each Squad is part of a Team
• Teams have a daily standup
Test Management
• Issues are tracked in JIRA
• Classified as Features, Change Requests, Bugs, &
Tasks
• Acceptance Criteria/Test Cases written against
Features & Change Requests
• AC must be reviewed and signed off on by Product
owners
• Written before development begins
Issue Management
• Daily review of all issues that are blocked
• Daily review of all issues that are missing AC
• Weekly reports run showing Story Point & Issue
Count increase/decrease
• Weekly reports showing burndown
Success Criteria
• Developer Challenges
• QA is now embedded within the Delivery team
• AC has been written ahead of time, and the entire Delivery team
works off of the same set
• QA Challenges
• Dev team has to keep QA in mind as they are now part of the Delivery
team
• Everyone works in a shared environment
• No time is wasted trying to re-document steps to reproduce an issue
• Leads Challenges
• No more back and forth between teams
• Features flow through at consistent rate
• Feature is deemed ready once the entire Delivery team has signed off
Q & A / Feedback
In Closing
• Jon Robinson (@jumpmancol)
• http://about.me/jumpmancol
Yes, I am a HUGE Cubs fan

More Related Content

What's hot

Scrumban benefits of both the worlds
Scrumban   benefits of both the worldsScrumban   benefits of both the worlds
Scrumban benefits of both the worlds
CoachingSaga
 

What's hot (20)

Going faster with kanban
Going faster with kanbanGoing faster with kanban
Going faster with kanban
 
Scrum basics
Scrum basicsScrum basics
Scrum basics
 
Leading IT Service Management from Scrum to Kanban
Leading IT Service Management from Scrum to KanbanLeading IT Service Management from Scrum to Kanban
Leading IT Service Management from Scrum to Kanban
 
Scrumban – lean software development
Scrumban – lean software developmentScrumban – lean software development
Scrumban – lean software development
 
Scrum101
Scrum101Scrum101
Scrum101
 
Scrumban - applying agile and lean practices for daily uncertainty by Vidas V...
Scrumban - applying agile and lean practices for daily uncertainty by Vidas V...Scrumban - applying agile and lean practices for daily uncertainty by Vidas V...
Scrumban - applying agile and lean practices for daily uncertainty by Vidas V...
 
Implementing kanban for services team
Implementing kanban for services teamImplementing kanban for services team
Implementing kanban for services team
 
Summer Scrum Public
Summer Scrum PublicSummer Scrum Public
Summer Scrum Public
 
Scrumban
ScrumbanScrumban
Scrumban
 
Introduction to kanban
Introduction to kanbanIntroduction to kanban
Introduction to kanban
 
Approaches to Kanban using Team Foundation Server - Dec 20
Approaches to Kanban using Team Foundation Server - Dec 20Approaches to Kanban using Team Foundation Server - Dec 20
Approaches to Kanban using Team Foundation Server - Dec 20
 
Shipping code is not the problem, deciding what to ship it is!
Shipping code is not the problem, deciding what to ship it is!Shipping code is not the problem, deciding what to ship it is!
Shipping code is not the problem, deciding what to ship it is!
 
Scrumban benefits of both the worlds
Scrumban   benefits of both the worldsScrumban   benefits of both the worlds
Scrumban benefits of both the worlds
 
From Dev and Ops to DevOps - reconfiguring the plane in flight.
From Dev and Ops to DevOps - reconfiguring the plane in flight. From Dev and Ops to DevOps - reconfiguring the plane in flight.
From Dev and Ops to DevOps - reconfiguring the plane in flight.
 
Scrumban
Scrumban Scrumban
Scrumban
 
Kanban for scrummers
Kanban for scrummersKanban for scrummers
Kanban for scrummers
 
Introduction to agile for freelancers
Introduction to agile for freelancersIntroduction to agile for freelancers
Introduction to agile for freelancers
 
Introduction to scrum at scale
Introduction to scrum at scaleIntroduction to scrum at scale
Introduction to scrum at scale
 
Beginning the Kanban journey at an Enterprise IT - Case study - Pelephone
Beginning the Kanban journey at an Enterprise IT - Case study - Pelephone Beginning the Kanban journey at an Enterprise IT - Case study - Pelephone
Beginning the Kanban journey at an Enterprise IT - Case study - Pelephone
 
Estimation
EstimationEstimation
Estimation
 

Similar to Qa & You

Project management for qa manager
Project management for qa managerProject management for qa manager
Project management for qa manager
gaoliang641
 
User centered agile dev balanced team 2013
User centered agile dev balanced team 2013User centered agile dev balanced team 2013
User centered agile dev balanced team 2013
Jay Trimble
 

Similar to Qa & You (20)

Getting Agile Right - Rebooting an Agile Organization in 100 days - Agile Tou...
Getting Agile Right - Rebooting an Agile Organization in 100 days - Agile Tou...Getting Agile Right - Rebooting an Agile Organization in 100 days - Agile Tou...
Getting Agile Right - Rebooting an Agile Organization in 100 days - Agile Tou...
 
Project management for qa manager
Project management for qa managerProject management for qa manager
Project management for qa manager
 
Agile India 2014 - Venkatraman L on Scaling Agile
Agile India 2014 - Venkatraman L on Scaling AgileAgile India 2014 - Venkatraman L on Scaling Agile
Agile India 2014 - Venkatraman L on Scaling Agile
 
Getting By Without "QA"
Getting By Without "QA"Getting By Without "QA"
Getting By Without "QA"
 
BoS2015 Jeff Szczepanski – COO, Stack Exchange - Stack Overflow. Scaling a Te...
BoS2015 Jeff Szczepanski – COO, Stack Exchange - Stack Overflow. Scaling a Te...BoS2015 Jeff Szczepanski – COO, Stack Exchange - Stack Overflow. Scaling a Te...
BoS2015 Jeff Szczepanski – COO, Stack Exchange - Stack Overflow. Scaling a Te...
 
Fundamentals of agile tntu (2015-04-27)
Fundamentals of agile   tntu (2015-04-27)Fundamentals of agile   tntu (2015-04-27)
Fundamentals of agile tntu (2015-04-27)
 
Real world experience from Microsoft - Deniz Ercoskun
Real world experience from Microsoft - Deniz ErcoskunReal world experience from Microsoft - Deniz Ercoskun
Real world experience from Microsoft - Deniz Ercoskun
 
User Centered Agile Development at NASA - One Groups Path to Better Software
User Centered Agile Development at NASA - One Groups Path to Better SoftwareUser Centered Agile Development at NASA - One Groups Path to Better Software
User Centered Agile Development at NASA - One Groups Path to Better Software
 
User centered agile dev balanced team 2013
User centered agile dev balanced team 2013User centered agile dev balanced team 2013
User centered agile dev balanced team 2013
 
The Dashlane Agile Journey
The Dashlane Agile JourneyThe Dashlane Agile Journey
The Dashlane Agile Journey
 
Scrum basics
Scrum basicsScrum basics
Scrum basics
 
When Management Asks You: “Do You Accept Agile as Your Lord and Savior?” - Ci...
When Management Asks You: “Do You Accept Agile as Your Lord and Savior?” - Ci...When Management Asks You: “Do You Accept Agile as Your Lord and Savior?” - Ci...
When Management Asks You: “Do You Accept Agile as Your Lord and Savior?” - Ci...
 
An approach to scaling Agile in Mid size Enterprise Application Stack/ Products
An approach to scaling Agile in Mid size Enterprise Application Stack/ Products An approach to scaling Agile in Mid size Enterprise Application Stack/ Products
An approach to scaling Agile in Mid size Enterprise Application Stack/ Products
 
IAM - One Year Later
IAM - One Year LaterIAM - One Year Later
IAM - One Year Later
 
Agile methodology and Scrum Framewwork
Agile methodology and Scrum FramewworkAgile methodology and Scrum Framewwork
Agile methodology and Scrum Framewwork
 
Beyond scrum of scrums scaling agile how it works
Beyond scrum of scrums scaling agile how it worksBeyond scrum of scrums scaling agile how it works
Beyond scrum of scrums scaling agile how it works
 
Five Steps to a More Agile Organization: Adopting Agility at Scale
Five Steps to a More Agile Organization: Adopting Agility at ScaleFive Steps to a More Agile Organization: Adopting Agility at Scale
Five Steps to a More Agile Organization: Adopting Agility at Scale
 
Agile quiz answers
Agile quiz answersAgile quiz answers
Agile quiz answers
 
Lean, Kanban, and TFS
Lean, Kanban, and TFSLean, Kanban, and TFS
Lean, Kanban, and TFS
 
Applying Quality to the Project and Product Management Process
Applying Quality to the Project and Product Management ProcessApplying Quality to the Project and Product Management Process
Applying Quality to the Project and Product Management Process
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 

Qa & You

  • 2. Agenda • Introduction • What are some of the challenges we are facing • How did we solve these challenges • Q & A / Feedback
  • 3. Introduction • My Name: Jon Robinson (@jumpmancol) • What I Do: QA Lead for Scripps WCM Platform • My Background: Started as a consultant, and have worked for both Fortune 500 companies as well as small startups. Wide range of industry experience; Banking, Financial Services, Insurance, Retail, Media
  • 4. Project Overview • Project has roughly ~60 people involved on a daily basis • ~40 are directly related to development or QA • ~20 are Project/Program level • Mass CHAOS!!!!!!!
  • 5. Developer Challenges • Very, very aggressive pace • QA team is a separate unit • Developers often work in isolation • Need precise steps to recreate issues that QA finds
  • 6. QA Challenges • Developers do not typically develop with QA in mind • Dev teams have a tendency to say “Well it works on my system” • A lot of valuable testing time is taken up in writing up the steps the dev teams need to recreate
  • 7. Leads Challenges • The back and forth nature of issues bouncing between teams is a giant time suck • A whole lot of “Hurry up and wait” happening • Accurately determining the readiness of a feature can be difficult
  • 8. The Squad Approach • A team of 2-3 people • Typically 2 developers, and 1 QA • Work in a pair programming approach • No longer separate Dev & QA designations, but rather a single Delivery team • Much more SCRUM-like • Each Squad is part of a Team • Teams have a daily standup
  • 9. Test Management • Issues are tracked in JIRA • Classified as Features, Change Requests, Bugs, & Tasks • Acceptance Criteria/Test Cases written against Features & Change Requests • AC must be reviewed and signed off on by Product owners • Written before development begins
  • 10. Issue Management • Daily review of all issues that are blocked • Daily review of all issues that are missing AC • Weekly reports run showing Story Point & Issue Count increase/decrease • Weekly reports showing burndown
  • 11. Success Criteria • Developer Challenges • QA is now embedded within the Delivery team • AC has been written ahead of time, and the entire Delivery team works off of the same set • QA Challenges • Dev team has to keep QA in mind as they are now part of the Delivery team • Everyone works in a shared environment • No time is wasted trying to re-document steps to reproduce an issue • Leads Challenges • No more back and forth between teams • Features flow through at consistent rate • Feature is deemed ready once the entire Delivery team has signed off
  • 12. Q & A / Feedback
  • 13. In Closing • Jon Robinson (@jumpmancol) • http://about.me/jumpmancol Yes, I am a HUGE Cubs fan