SlideShare una empresa de Scribd logo
1 de 30
1Confidential │ © 2020 VMware, Inc.
Dual-Track Agile
How to experiment at scale
Soumeya Benghanem
Nov, 2020
Confidential │ © 2020 VMware, Inc.
Agenda
2
Speaker Introduction
Logistics
What is Dual Agile?
What is Discovery & Framing?
The Dual Agile Approach
Staying Focused
Case Studies
Confidential │ © 2020 VMware, Inc.
Soumeya Benghanem
Currently at VMware Pivotal Labs
● 18 years of product management experience
● Startups and Fortune 500 companies
● B2C, B2B, SaaS
● Non-linear product management path: SE, Analyst, Project
Manager, Manager, Director, VP, Co-Founder, EVP, Staff PM
Speaker Introduction
Confidential │ © 2020 VMware, Inc.
Ask questions as you think of them, use the chat area. I will try to answer them
before moving to the next section
All participants are muted until we reach the questions section
If you have any follow-ups reach out to me at sbenghanem@vmware.com
Logistics
Confidential │ © 2020 VMware, Inc.
A framework that allows product teams to do two things
concurrently:
1. Start building software on day 1
2. Discover the problem and frame the solution that delivers the
most value
What is Dual Agile?
Lean Agile
Define Build &
Validat
e
iterate
Dual Agile
Define Build &
Validat
e
iterate
Build &
Validat
e
Confidential │ © 2020 VMware, Inc.
1. When time is an important factor
2. When you have important stakeholders who are
“experimentation” skeptics
3. When the value stream is complex and no one on the team is
an expert in the domain or domains it crosses
4. When you need to deliver outcomes at scale
5. When you are one lean agile team working within a
pathological or bureaucratic culture that you need to
cooperate or bridge with
6. When validating the “path-to-prod” is a high priority
assumption
When To Use Dual Agile?
Confidential │ © 2020 VMware, Inc. 7
Why build software on day 1?
Buy-in: getting valuable
software faster into the hands
of skeptical users is the best
way to get buy in
Morale: delivering valuable
software faster to customers
who appreciate it is the most
effective morale booster
Experimentation: early and
continuous engineering
experimentation to
validate/invalidate risky
assumptions
Buy-in, morale and attaining value
Product
Teams
Funding
Pressure
Confidential │ © 2020 VMware, Inc. 8
Why we do discovery and framing in parallel?
Risk Management: validate the
riskiest assumptions early
Validate the problem: what is
the “right” problem(s) to solve
Validate the solution: user-
validation of lean pieces of the
solution will build into bigger
validations of the big solution
Validation of the problem and the solution
Problem
Statement
Product
Proposition
Uncertainty Clarity
Time
Confidential │ © 2020 VMware, Inc. 9
Discovery and Framing Approach
Confidential │ © 2020 VMware, Inc. 10
Dual Agile Approach
AcceleratedD&FDeliberateD&F
Ideas & Scope Kickoff Inception MLP/MVP
Assumption
Generation &
Prioritization
Top Problem
Solution
Generation &
Prioritization
Prioritized
Backlog
Build
&
Validate
Inform
Influence
&
Merge
Confidential │ © 2020 VMware, Inc. 11
Dual Agile Time Dimension
Accelerated
D&F
DeliberateD&F
Ideas & Scope Kickoff Inception MLP/MVP
Assumption
Generation &
Prioritization
Top Problem
Solution
Generation &
Prioritization
Prioritized
Backlog
Build
&
Validate
1 Week
4-6 Weeks
Confidential │ © 2020 VMware, Inc.
How to Stay Focused
● Everyone on the team, and stakeholders, are aligned on:
‐ The assumptions
‐ The need for experimentation, and what to do with its results
● Product designers focus 90% of their time and energy on the deliberate D&F
● Engineers focus 90% of their time and energy on the accelerated D&F
● Daily and weekly ceremonies for the balanced team
● Product managers constantly and ruthlessly prioritizing
13Confidential │ © 2020 VMware, Inc.
Case Study: Medical App
Confidential │ © 2020 VMware, Inc.
Background
Large biopharmaceutical drug company launched a new drug to market in the last
few months
The company wants to build an online community around a valuable set of feature
for people who are likely to need immunosuppressive drugs
In 12 months, a competitor will be launching their own drug
Confidential │ © 2020 VMware, Inc.
Kickoff
Identified 4 risky assumptions:
1. People with autoimmune conditions need a way to identify symptoms and
triggers and it is hard to do that without the use of technology
2. There are many online communities but no apps geared towards autoimmune
conditions
3. The launch of the competitor’s drug will create market pressure and a need to
differentiate beyond drug efficacy
4. Legal approvals of features and copy take multiple weeks if not months
Confidential │ © 2020 VMware, Inc.
Staffing
6 engineers
2 product designers
2 content generators
2 product managers
Plus: data analysts, legal, marketing and other business stakeholders
Confidential │ © 2020 VMware, Inc.
Multi-Agile Approach
Workstreams 1 and 2- Accelerated D&F
Build an app that has the following features:
1. Online forum
2. Integration with Fitbit, Apple Health Kit, Diabetes trackers
3. Content
Workstream 3- Deliberate D&F
1. Validate problems and solutions before and after using the drug
Confidential │ © 2020 VMware, Inc.
Deliberate D&F Details
Service Blueprint
Since the company is
broken up by “business”
and “IT” functions we
started by creating a
business service
blueprint.
Output: Service Blueprint.
Event Storming
Used the input from the
service blueprint to start
then the extended
business and technology
team added more
details. Identified:
commands, aggregates,
constraints, timelines,
bounded contexts and
logical slices.
Output: Event Diagram.
Boris
Grouped activities and/or
slices into services that
interact and identified all
the communication
paths (data and people),
flow, api’s, scenarios,
and high level
architecture.
Output: Boris diagram.
Value Stream Map
Identified “problem
spots” such as excessive
lead-time or org
structures that can
impact the product’s
success.
Output: Value Stream
Map and baseline
metrics.
Due to the overall culture of the organization (bureaucratic and pathological) and the
complexity of the value-stream the D&F consisted of these key activities and
outputs”
Outcome: alignment
of the business
groups
Outcome: breaking down
complexity, ubiquitous language,
alignment of business and tech
Outcome: trouble spots
where optimization can
happen with or without
technology
Outcome: feature
backlog, notional
architecture
Because of organizational limitations
we had to start with a service
blueprint to “warm up” the business.
In most cases, you can just start with
an event storm.
8 Weeks
Confidential │ © 2020 VMware, Inc.
Results
In 8 weeks the team was able to:
1. Launch a Minimum Loveable Product in the App Store
2. Validate designs and features with users across multiple segments and
personas
3. Obtain legal approval prior to launch
20Confidential │ © 2020 VMware, Inc.
Case Study: Support App
Confidential │ © 2020 VMware, Inc.
Large Fortune 500 technology company wants to launch a new app during their annual user
conference in 2020 (e.g. Google I/O ).
The app should help users get support anywhere, anytime.
Currently, customers can receive support through web portals, email or phone calls.
This software company has hundreds of B2B products.
Background
Confidential │ © 2020 VMware, Inc.
Kickoff Results
Identified the top 2 riskiest assumptions:
1. App must be ready before the 2020 conference
2. Do our customers need or want an app to get support anywhere and anytime?
Confidential │ © 2020 VMware, Inc.
Staffing
1 Engineering Pair
1 Designer
1 Product manager
Plus: time from multiple SME’s with knowledge of existing systems and other
stakeholders
Confidential │ © 2020 VMware, Inc.
Dual Agile Approach
Confidential │ © 2020 VMware, Inc.
Results
In 5 weeks, the team learned the following:
Workstream 1:
● Gained an understanding of existing systems that we need to integrate with
● Built an MVP using React Native
Workstream 2:
● Determined through user interviews that a new app is not valuable
● Identified valuable features to be implemented in existing systems
26Confidential │ © 2020 VMware, Inc.
THANK YOU!
Any Questions?
Confidential │ © 2020 VMware, Inc. 27
Appendix
Confidential │ © 2020 VMware, Inc.
What is an experiment?
In an ideal experiment the tester separates an independent variable (the presumed
cause) from a dependent variable (the observed effect) while holding all other potential
causes constant, and then manipulates the former to study changes in the latter.
Confidential │ © 2020 VMware, Inc. 29
Discovery
Objectives
● Understand what problem the product will solve
● Understand users, customers, domain
● Identify opportunities and constraints
● Ensure we solve the right problems
Example Activities
● Conducting ethnographic research
● Competitive/market analysis
● Defining user personas
● Synthesizing insights
● Exploring the product proposition
Confidential │ © 2020 VMware, Inc. 30
Framing
Objectives
● Validate the riskiest assumptions early
● Establish models and frame solutions
● Remove enough uncertainty so we can begin
development and be confident we are heading
in the right direction
● Reduce risk through constant user validation
Example Activities
● Shape high level experience framework
● Technical spikes
● Service blueprints
● Develop workflows
● Scenario mapping
● Prioritise MVP features

Más contenido relacionado

La actualidad más candente

Lean & Agile Organizational Leadership: History, Theory, Models, & Popular Ideas
Lean & Agile Organizational Leadership: History, Theory, Models, & Popular IdeasLean & Agile Organizational Leadership: History, Theory, Models, & Popular Ideas
Lean & Agile Organizational Leadership: History, Theory, Models, & Popular IdeasDavid Rico
 
The Agile Product Owner: Beyond the Books and Classrooms
The Agile Product Owner: Beyond the Books and ClassroomsThe Agile Product Owner: Beyond the Books and Classrooms
The Agile Product Owner: Beyond the Books and ClassroomsEnterprise Knowledge
 
Developing Agile Leadership
Developing Agile LeadershipDeveloping Agile Leadership
Developing Agile LeadershipPete Behrens
 
What the Heck Is a Product Owner?
What the Heck Is a Product Owner?What the Heck Is a Product Owner?
What the Heck Is a Product Owner?Ron Lichty
 
Customer to Product Idea Iteration by Amazon's Product Manager
Customer to Product Idea Iteration by Amazon's Product ManagerCustomer to Product Idea Iteration by Amazon's Product Manager
Customer to Product Idea Iteration by Amazon's Product ManagerProduct School
 
Agile có thể giúp chúng ta những gì?
Agile có thể giúp chúng ta những gì?Agile có thể giúp chúng ta những gì?
Agile có thể giúp chúng ta những gì?DUONG Trong Tan
 
Agile Placemat v9
Agile Placemat v9Agile Placemat v9
Agile Placemat v9Chris Webb
 
Evidenced based management - Presentation at Scrum Australia 24 oct 2018
Evidenced based management - Presentation at Scrum Australia 24 oct 2018Evidenced based management - Presentation at Scrum Australia 24 oct 2018
Evidenced based management - Presentation at Scrum Australia 24 oct 2018Mia Horrigan
 
12 Agile Principles in Pictures
12 Agile Principles in Pictures12 Agile Principles in Pictures
12 Agile Principles in PicturesIAMCP MENTORING
 
FLIGHT LEVELS OF KANBAN (KLAUS LEOPOLD) - LKCE13
FLIGHT LEVELS OF KANBAN (KLAUS LEOPOLD) - LKCE13FLIGHT LEVELS OF KANBAN (KLAUS LEOPOLD) - LKCE13
FLIGHT LEVELS OF KANBAN (KLAUS LEOPOLD) - LKCE13Lean Kanban Central Europe
 
Product Owner and Strategy
Product Owner and StrategyProduct Owner and Strategy
Product Owner and StrategyRoman Pichler
 
Lean Change Agent - Applying Lean and Agile to Change Management
Lean Change Agent - Applying Lean and Agile to Change ManagementLean Change Agent - Applying Lean and Agile to Change Management
Lean Change Agent - Applying Lean and Agile to Change ManagementJason Little
 
Creating Agile Product Roadmaps Everyone Understands
Creating Agile Product Roadmaps Everyone UnderstandsCreating Agile Product Roadmaps Everyone Understands
Creating Agile Product Roadmaps Everyone Understandsuxpin
 

La actualidad más candente (20)

Scrum Product Owner
Scrum Product OwnerScrum Product Owner
Scrum Product Owner
 
Ahmed Sidky (Keynote)
Ahmed Sidky (Keynote)Ahmed Sidky (Keynote)
Ahmed Sidky (Keynote)
 
Introduction to Agile and Scrum
Introduction to Agile and ScrumIntroduction to Agile and Scrum
Introduction to Agile and Scrum
 
Lean & Agile Organizational Leadership: History, Theory, Models, & Popular Ideas
Lean & Agile Organizational Leadership: History, Theory, Models, & Popular IdeasLean & Agile Organizational Leadership: History, Theory, Models, & Popular Ideas
Lean & Agile Organizational Leadership: History, Theory, Models, & Popular Ideas
 
The Agile Product Owner: Beyond the Books and Classrooms
The Agile Product Owner: Beyond the Books and ClassroomsThe Agile Product Owner: Beyond the Books and Classrooms
The Agile Product Owner: Beyond the Books and Classrooms
 
Developing Agile Leadership
Developing Agile LeadershipDeveloping Agile Leadership
Developing Agile Leadership
 
UX and Scrum
UX and ScrumUX and Scrum
UX and Scrum
 
What the Heck Is a Product Owner?
What the Heck Is a Product Owner?What the Heck Is a Product Owner?
What the Heck Is a Product Owner?
 
Customer to Product Idea Iteration by Amazon's Product Manager
Customer to Product Idea Iteration by Amazon's Product ManagerCustomer to Product Idea Iteration by Amazon's Product Manager
Customer to Product Idea Iteration by Amazon's Product Manager
 
Ahmed Sidky (ICAgile)
Ahmed Sidky (ICAgile)Ahmed Sidky (ICAgile)
Ahmed Sidky (ICAgile)
 
Agile Metrics 101
Agile Metrics 101Agile Metrics 101
Agile Metrics 101
 
Agile có thể giúp chúng ta những gì?
Agile có thể giúp chúng ta những gì?Agile có thể giúp chúng ta những gì?
Agile có thể giúp chúng ta những gì?
 
Agile Placemat v9
Agile Placemat v9Agile Placemat v9
Agile Placemat v9
 
Evidenced based management - Presentation at Scrum Australia 24 oct 2018
Evidenced based management - Presentation at Scrum Australia 24 oct 2018Evidenced based management - Presentation at Scrum Australia 24 oct 2018
Evidenced based management - Presentation at Scrum Australia 24 oct 2018
 
12 Agile Principles in Pictures
12 Agile Principles in Pictures12 Agile Principles in Pictures
12 Agile Principles in Pictures
 
FLIGHT LEVELS OF KANBAN (KLAUS LEOPOLD) - LKCE13
FLIGHT LEVELS OF KANBAN (KLAUS LEOPOLD) - LKCE13FLIGHT LEVELS OF KANBAN (KLAUS LEOPOLD) - LKCE13
FLIGHT LEVELS OF KANBAN (KLAUS LEOPOLD) - LKCE13
 
Product Owner and Strategy
Product Owner and StrategyProduct Owner and Strategy
Product Owner and Strategy
 
Lean Change Agent - Applying Lean and Agile to Change Management
Lean Change Agent - Applying Lean and Agile to Change ManagementLean Change Agent - Applying Lean and Agile to Change Management
Lean Change Agent - Applying Lean and Agile to Change Management
 
Jira Agile
Jira AgileJira Agile
Jira Agile
 
Creating Agile Product Roadmaps Everyone Understands
Creating Agile Product Roadmaps Everyone UnderstandsCreating Agile Product Roadmaps Everyone Understands
Creating Agile Product Roadmaps Everyone Understands
 

Similar a Dual-Track Agile at Scale

Mendix Essentials Presentatie Gerolf Roovers26/08/2011
Mendix Essentials Presentatie Gerolf Roovers26/08/2011Mendix Essentials Presentatie Gerolf Roovers26/08/2011
Mendix Essentials Presentatie Gerolf Roovers26/08/2011Mendix
 
ANIn Coimbatore March 2023 |How Did Feedback Loops Help To Build Better Produ...
ANIn Coimbatore March 2023 |How Did Feedback Loops Help To Build Better Produ...ANIn Coimbatore March 2023 |How Did Feedback Loops Help To Build Better Produ...
ANIn Coimbatore March 2023 |How Did Feedback Loops Help To Build Better Produ...AgileNetwork
 
IBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOpsIBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOpsSanjeev Sharma
 
Building DevOps in the Enterprise: Balancing Centralized and Decentralized Teams
Building DevOps in the Enterprise: Balancing Centralized and Decentralized TeamsBuilding DevOps in the Enterprise: Balancing Centralized and Decentralized Teams
Building DevOps in the Enterprise: Balancing Centralized and Decentralized TeamsDevOps.com
 
Power to the People! Shifting from Project to Product with Tasktop Viz
Power to the People! Shifting from Project to Product with Tasktop VizPower to the People! Shifting from Project to Product with Tasktop Viz
Power to the People! Shifting from Project to Product with Tasktop VizTasktop
 
Aaron Swain at VMware Tanzu Public Sector Connect 2021
Aaron Swain at VMware Tanzu Public Sector Connect 2021Aaron Swain at VMware Tanzu Public Sector Connect 2021
Aaron Swain at VMware Tanzu Public Sector Connect 2021VMware Tanzu
 
Bhadale group of companies general framework-level-2
Bhadale group of companies  general framework-level-2Bhadale group of companies  general framework-level-2
Bhadale group of companies general framework-level-2Vijayananda Mohire
 
Lean Product Management User-Centered App Design
Lean Product Management User-Centered App DesignLean Product Management User-Centered App Design
Lean Product Management User-Centered App DesignVMware Tanzu
 
Agile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective ActionsAgile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective ActionsTechWell
 
July 30: How User-Centered Design Drives Impactful Products and Services
July 30: How User-Centered Design Drives Impactful Products and ServicesJuly 30: How User-Centered Design Drives Impactful Products and Services
July 30: How User-Centered Design Drives Impactful Products and ServicesVMware Tanzu
 
How to Drive More Value From Innovation Initiatives
How to Drive More Value From Innovation InitiativesHow to Drive More Value From Innovation Initiatives
How to Drive More Value From Innovation InitiativesVMware Tanzu
 
A Recipe for Scale: Succeeding with Agile Software Development in the Enterprise
A Recipe for Scale: Succeeding with Agile Software Development in the EnterpriseA Recipe for Scale: Succeeding with Agile Software Development in the Enterprise
A Recipe for Scale: Succeeding with Agile Software Development in the EnterpriseVMware Tanzu
 
Odoo Implementation Methodology
Odoo Implementation MethodologyOdoo Implementation Methodology
Odoo Implementation MethodologyQuang Ngoc
 
Odoo implementation
Odoo implementationOdoo implementation
Odoo implementationOdoo Thaidev
 
DevOps for Enterprise Systems : Innovate like a Startup
DevOps for Enterprise Systems : Innovate like a StartupDevOps for Enterprise Systems : Innovate like a Startup
DevOps for Enterprise Systems : Innovate like a StartupDevOps for Enterprise Systems
 
Presentation by lavika upadhyay
Presentation by lavika upadhyayPresentation by lavika upadhyay
Presentation by lavika upadhyayPMI_IREP_TP
 
Cuelogic technologies
Cuelogic technologiesCuelogic technologies
Cuelogic technologiesnikhilambekar
 
Enterprise Software Implementation
Enterprise Software ImplementationEnterprise Software Implementation
Enterprise Software Implementationbrh184
 
Week Four JournalObjectiveYou will identify key ethical proble.docx
Week Four JournalObjectiveYou will identify key ethical proble.docxWeek Four JournalObjectiveYou will identify key ethical proble.docx
Week Four JournalObjectiveYou will identify key ethical proble.docxalanfhall8953
 

Similar a Dual-Track Agile at Scale (20)

Mendix Essentials Presentatie Gerolf Roovers26/08/2011
Mendix Essentials Presentatie Gerolf Roovers26/08/2011Mendix Essentials Presentatie Gerolf Roovers26/08/2011
Mendix Essentials Presentatie Gerolf Roovers26/08/2011
 
ANIn Coimbatore March 2023 |How Did Feedback Loops Help To Build Better Produ...
ANIn Coimbatore March 2023 |How Did Feedback Loops Help To Build Better Produ...ANIn Coimbatore March 2023 |How Did Feedback Loops Help To Build Better Produ...
ANIn Coimbatore March 2023 |How Did Feedback Loops Help To Build Better Produ...
 
IBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOpsIBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOps
 
Building DevOps in the Enterprise: Balancing Centralized and Decentralized Teams
Building DevOps in the Enterprise: Balancing Centralized and Decentralized TeamsBuilding DevOps in the Enterprise: Balancing Centralized and Decentralized Teams
Building DevOps in the Enterprise: Balancing Centralized and Decentralized Teams
 
Power to the People! Shifting from Project to Product with Tasktop Viz
Power to the People! Shifting from Project to Product with Tasktop VizPower to the People! Shifting from Project to Product with Tasktop Viz
Power to the People! Shifting from Project to Product with Tasktop Viz
 
Aaron Swain at VMware Tanzu Public Sector Connect 2021
Aaron Swain at VMware Tanzu Public Sector Connect 2021Aaron Swain at VMware Tanzu Public Sector Connect 2021
Aaron Swain at VMware Tanzu Public Sector Connect 2021
 
Bhadale group of companies general framework-level-2
Bhadale group of companies  general framework-level-2Bhadale group of companies  general framework-level-2
Bhadale group of companies general framework-level-2
 
Lean Product Management User-Centered App Design
Lean Product Management User-Centered App DesignLean Product Management User-Centered App Design
Lean Product Management User-Centered App Design
 
Agile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective ActionsAgile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective Actions
 
July 30: How User-Centered Design Drives Impactful Products and Services
July 30: How User-Centered Design Drives Impactful Products and ServicesJuly 30: How User-Centered Design Drives Impactful Products and Services
July 30: How User-Centered Design Drives Impactful Products and Services
 
BUDDY White Paper
BUDDY White PaperBUDDY White Paper
BUDDY White Paper
 
How to Drive More Value From Innovation Initiatives
How to Drive More Value From Innovation InitiativesHow to Drive More Value From Innovation Initiatives
How to Drive More Value From Innovation Initiatives
 
A Recipe for Scale: Succeeding with Agile Software Development in the Enterprise
A Recipe for Scale: Succeeding with Agile Software Development in the EnterpriseA Recipe for Scale: Succeeding with Agile Software Development in the Enterprise
A Recipe for Scale: Succeeding with Agile Software Development in the Enterprise
 
Odoo Implementation Methodology
Odoo Implementation MethodologyOdoo Implementation Methodology
Odoo Implementation Methodology
 
Odoo implementation
Odoo implementationOdoo implementation
Odoo implementation
 
DevOps for Enterprise Systems : Innovate like a Startup
DevOps for Enterprise Systems : Innovate like a StartupDevOps for Enterprise Systems : Innovate like a Startup
DevOps for Enterprise Systems : Innovate like a Startup
 
Presentation by lavika upadhyay
Presentation by lavika upadhyayPresentation by lavika upadhyay
Presentation by lavika upadhyay
 
Cuelogic technologies
Cuelogic technologiesCuelogic technologies
Cuelogic technologies
 
Enterprise Software Implementation
Enterprise Software ImplementationEnterprise Software Implementation
Enterprise Software Implementation
 
Week Four JournalObjectiveYou will identify key ethical proble.docx
Week Four JournalObjectiveYou will identify key ethical proble.docxWeek Four JournalObjectiveYou will identify key ethical proble.docx
Week Four JournalObjectiveYou will identify key ethical proble.docx
 

Último

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdfChristopherTHyatt
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 

Último (20)

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 

Dual-Track Agile at Scale

  • 1. 1Confidential │ © 2020 VMware, Inc. Dual-Track Agile How to experiment at scale Soumeya Benghanem Nov, 2020
  • 2. Confidential │ © 2020 VMware, Inc. Agenda 2 Speaker Introduction Logistics What is Dual Agile? What is Discovery & Framing? The Dual Agile Approach Staying Focused Case Studies
  • 3. Confidential │ © 2020 VMware, Inc. Soumeya Benghanem Currently at VMware Pivotal Labs ● 18 years of product management experience ● Startups and Fortune 500 companies ● B2C, B2B, SaaS ● Non-linear product management path: SE, Analyst, Project Manager, Manager, Director, VP, Co-Founder, EVP, Staff PM Speaker Introduction
  • 4. Confidential │ © 2020 VMware, Inc. Ask questions as you think of them, use the chat area. I will try to answer them before moving to the next section All participants are muted until we reach the questions section If you have any follow-ups reach out to me at sbenghanem@vmware.com Logistics
  • 5. Confidential │ © 2020 VMware, Inc. A framework that allows product teams to do two things concurrently: 1. Start building software on day 1 2. Discover the problem and frame the solution that delivers the most value What is Dual Agile? Lean Agile Define Build & Validat e iterate Dual Agile Define Build & Validat e iterate Build & Validat e
  • 6. Confidential │ © 2020 VMware, Inc. 1. When time is an important factor 2. When you have important stakeholders who are “experimentation” skeptics 3. When the value stream is complex and no one on the team is an expert in the domain or domains it crosses 4. When you need to deliver outcomes at scale 5. When you are one lean agile team working within a pathological or bureaucratic culture that you need to cooperate or bridge with 6. When validating the “path-to-prod” is a high priority assumption When To Use Dual Agile?
  • 7. Confidential │ © 2020 VMware, Inc. 7 Why build software on day 1? Buy-in: getting valuable software faster into the hands of skeptical users is the best way to get buy in Morale: delivering valuable software faster to customers who appreciate it is the most effective morale booster Experimentation: early and continuous engineering experimentation to validate/invalidate risky assumptions Buy-in, morale and attaining value Product Teams Funding Pressure
  • 8. Confidential │ © 2020 VMware, Inc. 8 Why we do discovery and framing in parallel? Risk Management: validate the riskiest assumptions early Validate the problem: what is the “right” problem(s) to solve Validate the solution: user- validation of lean pieces of the solution will build into bigger validations of the big solution Validation of the problem and the solution Problem Statement Product Proposition Uncertainty Clarity Time
  • 9. Confidential │ © 2020 VMware, Inc. 9 Discovery and Framing Approach
  • 10. Confidential │ © 2020 VMware, Inc. 10 Dual Agile Approach AcceleratedD&FDeliberateD&F Ideas & Scope Kickoff Inception MLP/MVP Assumption Generation & Prioritization Top Problem Solution Generation & Prioritization Prioritized Backlog Build & Validate Inform Influence & Merge
  • 11. Confidential │ © 2020 VMware, Inc. 11 Dual Agile Time Dimension Accelerated D&F DeliberateD&F Ideas & Scope Kickoff Inception MLP/MVP Assumption Generation & Prioritization Top Problem Solution Generation & Prioritization Prioritized Backlog Build & Validate 1 Week 4-6 Weeks
  • 12. Confidential │ © 2020 VMware, Inc. How to Stay Focused ● Everyone on the team, and stakeholders, are aligned on: ‐ The assumptions ‐ The need for experimentation, and what to do with its results ● Product designers focus 90% of their time and energy on the deliberate D&F ● Engineers focus 90% of their time and energy on the accelerated D&F ● Daily and weekly ceremonies for the balanced team ● Product managers constantly and ruthlessly prioritizing
  • 13. 13Confidential │ © 2020 VMware, Inc. Case Study: Medical App
  • 14. Confidential │ © 2020 VMware, Inc. Background Large biopharmaceutical drug company launched a new drug to market in the last few months The company wants to build an online community around a valuable set of feature for people who are likely to need immunosuppressive drugs In 12 months, a competitor will be launching their own drug
  • 15. Confidential │ © 2020 VMware, Inc. Kickoff Identified 4 risky assumptions: 1. People with autoimmune conditions need a way to identify symptoms and triggers and it is hard to do that without the use of technology 2. There are many online communities but no apps geared towards autoimmune conditions 3. The launch of the competitor’s drug will create market pressure and a need to differentiate beyond drug efficacy 4. Legal approvals of features and copy take multiple weeks if not months
  • 16. Confidential │ © 2020 VMware, Inc. Staffing 6 engineers 2 product designers 2 content generators 2 product managers Plus: data analysts, legal, marketing and other business stakeholders
  • 17. Confidential │ © 2020 VMware, Inc. Multi-Agile Approach Workstreams 1 and 2- Accelerated D&F Build an app that has the following features: 1. Online forum 2. Integration with Fitbit, Apple Health Kit, Diabetes trackers 3. Content Workstream 3- Deliberate D&F 1. Validate problems and solutions before and after using the drug
  • 18. Confidential │ © 2020 VMware, Inc. Deliberate D&F Details Service Blueprint Since the company is broken up by “business” and “IT” functions we started by creating a business service blueprint. Output: Service Blueprint. Event Storming Used the input from the service blueprint to start then the extended business and technology team added more details. Identified: commands, aggregates, constraints, timelines, bounded contexts and logical slices. Output: Event Diagram. Boris Grouped activities and/or slices into services that interact and identified all the communication paths (data and people), flow, api’s, scenarios, and high level architecture. Output: Boris diagram. Value Stream Map Identified “problem spots” such as excessive lead-time or org structures that can impact the product’s success. Output: Value Stream Map and baseline metrics. Due to the overall culture of the organization (bureaucratic and pathological) and the complexity of the value-stream the D&F consisted of these key activities and outputs” Outcome: alignment of the business groups Outcome: breaking down complexity, ubiquitous language, alignment of business and tech Outcome: trouble spots where optimization can happen with or without technology Outcome: feature backlog, notional architecture Because of organizational limitations we had to start with a service blueprint to “warm up” the business. In most cases, you can just start with an event storm. 8 Weeks
  • 19. Confidential │ © 2020 VMware, Inc. Results In 8 weeks the team was able to: 1. Launch a Minimum Loveable Product in the App Store 2. Validate designs and features with users across multiple segments and personas 3. Obtain legal approval prior to launch
  • 20. 20Confidential │ © 2020 VMware, Inc. Case Study: Support App
  • 21. Confidential │ © 2020 VMware, Inc. Large Fortune 500 technology company wants to launch a new app during their annual user conference in 2020 (e.g. Google I/O ). The app should help users get support anywhere, anytime. Currently, customers can receive support through web portals, email or phone calls. This software company has hundreds of B2B products. Background
  • 22. Confidential │ © 2020 VMware, Inc. Kickoff Results Identified the top 2 riskiest assumptions: 1. App must be ready before the 2020 conference 2. Do our customers need or want an app to get support anywhere and anytime?
  • 23. Confidential │ © 2020 VMware, Inc. Staffing 1 Engineering Pair 1 Designer 1 Product manager Plus: time from multiple SME’s with knowledge of existing systems and other stakeholders
  • 24. Confidential │ © 2020 VMware, Inc. Dual Agile Approach
  • 25. Confidential │ © 2020 VMware, Inc. Results In 5 weeks, the team learned the following: Workstream 1: ● Gained an understanding of existing systems that we need to integrate with ● Built an MVP using React Native Workstream 2: ● Determined through user interviews that a new app is not valuable ● Identified valuable features to be implemented in existing systems
  • 26. 26Confidential │ © 2020 VMware, Inc. THANK YOU! Any Questions?
  • 27. Confidential │ © 2020 VMware, Inc. 27 Appendix
  • 28. Confidential │ © 2020 VMware, Inc. What is an experiment? In an ideal experiment the tester separates an independent variable (the presumed cause) from a dependent variable (the observed effect) while holding all other potential causes constant, and then manipulates the former to study changes in the latter.
  • 29. Confidential │ © 2020 VMware, Inc. 29 Discovery Objectives ● Understand what problem the product will solve ● Understand users, customers, domain ● Identify opportunities and constraints ● Ensure we solve the right problems Example Activities ● Conducting ethnographic research ● Competitive/market analysis ● Defining user personas ● Synthesizing insights ● Exploring the product proposition
  • 30. Confidential │ © 2020 VMware, Inc. 30 Framing Objectives ● Validate the riskiest assumptions early ● Establish models and frame solutions ● Remove enough uncertainty so we can begin development and be confident we are heading in the right direction ● Reduce risk through constant user validation Example Activities ● Shape high level experience framework ● Technical spikes ● Service blueprints ● Develop workflows ● Scenario mapping ● Prioritise MVP features

Notas del editor

  1. If you are the pivot, the most valuable slides might be 4, 8 and 16
  2. The image looks linear but since we use lean agile, think of it as iterative with feedback loops back and forth
  3. The reference to pathological and bureaucratic culture structures is based on this research: https://qualitysafety.bmj.com/content/13/suppl_2/ii22 When time is an important factor: managing to time is a losing battle for product teams. But it is a reality that has to be faced often. Isolate the assumptions that will have the most impact on time and start working on them sooner rather than later. When you have important stakeholders who are “experimentation” skeptics When the value stream is complex and no one on the team is an expert in the domain or domains it crosses: large enterprises always have complex value streams. The D&F in these situations rarely lasts 4 weeks. To give the team time to get up to speed on the domains that are part of the product, take out D&F as a dependency for code on day one, or asap. When you need to deliver outcomes at scale: when all the hypotheses around the problem point to a solution that will impact many teams or customer segments. Again this is a case where D&F will most likely take longer to get to inception (and alignment of all the stakeholders). When you are one lean agile team working within a pathological or bureaucratic culture that you need to cooperate or bridge with: has anyone worked on a project where your key customers don’t answer your emails for weeks? Or refuse to meet for weeks? It happens, and depending on the engagement sponsor you might have no power to influence your stakeholders to move any faster. Don’t hold up the whole team, start building based on what you know while you continue driving the D&F activities with “low-cooperation” users. When validating the “path-to-prod” is a high priority assumption: I see this one in 80% of my projects, where the team need to build their own pipelines. Do that, it will be necessary if you want to ship code… at least 80% of the time.
  4. Typical pressure I see in “legacy” enterprise settings: business is skeptical that IT can deliver valuable software. So we need to disprove that right away to gain continued cooperation.
  5. Content for non-pivots to familiarize them with D&F
  6. https://VMware.zoom.us/j/99916071629?pwd=TmZ6Q3ZUOTM4S2t5MVY3NlRGY1FCUT09
  7. The cognitive load is real. Do the basics well: anti-goals define early and don’t forget them, keep your assumptions/risk updated, prioritize the backlog
  8. Resources: Event storming and Boris (minutes 1-31): https://www.youtube.com/watch?v=neL3OQ1GRhY Service blueprint: https://www.slideshare.net/KuldeepKulshreshtha/take-a-holistic-view-of-your-product-with-service-blueprints-at-uxsea-summit-2018 Boris name based on the song Boris by the Who, it talks about a spider called Boris