SlideShare una empresa de Scribd logo
1 de 77
Descargar para leer sin conexión
blog: jabe.co
FAILING
principles and practices of
Vanity Validation a Paradox of Passionate Commitment
WELL
@cyetain
What was the last thing you
failed at?
What did you learn?
Did you share your failure
with anyone?
Pre-Talk Questions
blog: jabe.co
FAILING
principles and practices of
Vanity Validation a Paradox of Passionate Commitment
WELL
HELLLOOOO McFLY
TLC LABS
blog http://jabe.co
Send Anonymous Feedback
http://sayat.me/jabebloom
Joshua (Jabe) Bloom
CTO : The Library Corporation
& Consulting Practioner TLC Labs
#agile2013
@cyetain
Fail Fast
@cyetain
@cyetain
Learning occurs when we
detect and correct error. Error is
any mismatch between what
we intend an action to produce
and what actually happens
when we implement that action.
-Chris Argyris
@cyetain
How Do We Make Better Choices?
Why is it so hard to Fail?
Could we design a system to help?
@cyetain
One must treat his theory-in-
use as both a psychological
certainty and an intellectual
hypothesis.
-Chris Argyris
@cyetain
How wonderful that we have
met with a paradox. Now we
have some hope of making
progress.
-Niels Bohr
@cyetain
@cyetain
fake dictionary page from colbertnation.com
@cyetain
Although theory without
experiment is empty,
experiment without theory is
blind.
-Paul Thagard
@cyetain
3 Things To Leave With
• Failing Well Produces more Information than
Failing Poorly
• “Passionate Beliefs, Loosely Held”
• Reducing Variability too, Soon risks
suboptimal result, too Late increases Failure
blindness
@cyetain
We simply cannot rely on
randomness to correct
the problems that
randomness creates.
-Don Reinertsen
@cyetain
undifferentiated streams
of data
@cyetain
@cyetain
“Research is what
I’m doing when I
don’t know what
I’m doing.”
-Wernher von Braun
@cyetain
@cyetain
The Principle of Optimum Failure Rate
0% 100%
Probability of Failure
50%
PotentialInformation
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Greater Asserted
Information
Greater Asserted
Information
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Greater Asserted
Information
Greater Asserted
Information
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Greater Asserted
Information
Greater Asserted
Information
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
Uncomfortable
Confident
@cyetain
Experience of Failure
NumberofSamples The Competency Trap
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
IdeasHidden
Risk
Hidden
Value
The Line of SURPRISE!
@cyetain
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
IdeasHidden
Risk
Hidden
Value
1
2
3
During Customer Development Focus on Interesting Ideas
Before Scaling Validate Your "We Know This Assumptions" to
reduce risk of Failure Demand
After Customer Validation Run experiments to Validate Assumptions of Failure
2
3
1
@cyetain
“The typical sequence of coin
tosses has high information
content but little value; an
ephemeris, giving the
positions of the moon and
planets every day for a
hundred years, has no more
information than the
equations of motion and
initial conditions from which
it was calculated, but saves
it’s owner the effort of
recalculating these positions.”
-Charles H. Bennett
@cyetain
Based on what we know
right now, what problems
do we have the least
amount of information
about that we can
reasonably expect to
understand?
@cyetain
@cyetain
Risk vs Uncertainty
@cyetain
Alteaory vs Epistemic
Uncertainties
@cyetain
Gamble Invest
@cyetain
Justified MVP
Value of Information
Cost of Acquisition
Cost of MVP
Unjustified
MVP
Over Justified
MVP
Justified
MVP
@cyetain
The first principle is that
you must not fool
yourself--and you are the
easiest person to fool.
-Richard Feynman
@cyetain
“Most people don’t know how to
learn. What’s more, those
members of the organization that
many assume to be the best at
learning are, in fact, not very
good at it. I am talking about the
well-educated, high-powered, high
commitment professionals”
-Chris Argyris
@cyetain
“Expertise … breeds an
inability to accept new
views.”
-Laski
@cyetain
@cyetain
VanityValidation
@cyetain
I need to be right even
if I'm wrong.
@cyetain
Defensive Reasoning
@cyetain
Remain in unilateral
control
@cyetain
Maximize "winning"
Minimize "losing"
@cyetain
Suppress negative
feelings
@cyetain
Be as "rational" as possible
-- by which people mean
defining clear objectives and
evaluating their behavior in
terms of whether or not
they have achieved them
@cyetain
Mindset Actions
Results Match
Results Mismatch
Single-loop
Double-loop
@cyetain
Valid Public
Information
@cyetain
@cyetain
whenever we propose a
solution to a problem, we
ought to try as hard as we
can to overthrow our solution,
rather than defend it.
-Karl Popper
@cyetain
• Identify Your Assumptions and Conclusions
CLEARLY AS POSSIBLE PUBLICLY
• Question Your Assumptions and Conclusions
• Seek Contrary Data
• Learn when to correct your Actions and
when to correct your Mindset
@cyetain
http://xkcd.com/
@cyetain
@cyetain
Abduction
not just for
Aliens
@cyetain
@cyetain
[Abduction] goes upon the hope that
there is sufficient affinity between the
reasoner's mind and nature's to render
guessing not altogether hopeless,
provided each guess is checked by
comparison with observation... The
effort should therefore be to make
each hypothesis... as near an even bet
as possible.
-Charles Peirce
@cyetain
ABDUCE
DEDUCE
INDUCE
Predictive
Probable
Plausible
The Way
Computers "Think"
The Way
Humans Think
Binary
Probability
Analogue
Justifiable
@cyetain
ABDUCE
DEDUCE
INDUCE
Experiences Hypothesises
Expected
Outcomes
If Coherent
If Expected Outcomes
Match Reality
Effective
Match
@cyetain
ABDUCE
DEDUCEINDUCE
@cyetain
ABDUCE
DEDUCEINDUCE
SURPRISE!!!
@cyetain
Multi-Hypothesis Research
!=
@cyetain
BRAINSTORM
@cyetain
Theories
Opinions
Hypothesizes
The Facts and Just
the Facts
@cyetain
Theories
Opinions
Hypothesizes
Constraints
Criteria
@cyetain
Theories
Opinions
Hypothesizes
Question
Facts
@cyetain
Theories
Opinions
Hypothesizes Request More
Information
@cyetain
NO TALKING!
@cyetain
How Would I Validate my
understanding of this
problem?
How Would I
solve this
Problem?
•Based on your experiences, what
would you do to solve this
problem? This is your Hypothesis.
•Identify What Needs to Be True if
your Hypothesis is true.
•Assert, Presume, Assume Truth
•Imagine Experiments that would
justify the Assumptions
@cyetain
I Assert that this I
know this
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
I Presume
Somebody
knows this
I am going to Assume
this is true for my
Hypothesis to be true
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
0% 100%
Probability of Failure
50%
PotentialInformation
Pretty
Sure
theory
is wrong
Pretty
Sure
theory
is right
Interesting
Ideas
@cyetain
This is my Hypothesis,
Assumptions and
Experiments
Challenge
Assumptions &
Experiments
Rotate Pairs 2-3 Times
Allow Time for Revision Between Rounds
@cyetain
This is my Hypothesis,
Assumptions and
Experiments
@cyetain
Multiple Smaller Experiments
against
Multiple Abductive Hypotheses
instead of
Single Large Experiment
against
Single Hypotheses
@cyetain
Failing Well Produces more
Information than Failing
Poorly
@cyetain
What are You Doing w All that Information?
Incremental: Confirm. Disconfirm.
Iteratively: Select Next Step. Generate More
Options
@cyetain
Having “Passionate
Beliefs, Loosely Held”
FAILURE
MUST
BE AN OPTION
@cyetain
Reducing Variability too
soon risks suboptimal
result, too late increases
failure demand
@cyetain
@cyetain
Influences
&
Sources of More Information
@cyetain
Joshua (Jabe) Bloom
CTO : The Library Corporation
& TLC Labs
blog http://jabe.co
Send Anonymous Feedback
http://sayat.me/jabebloom

Más contenido relacionado

Más de Jabe Bloom

Three frames DevOpsDays ATL
Three frames DevOpsDays ATLThree frames DevOpsDays ATL
Three frames DevOpsDays ATLJabe Bloom
 
Monkey Mind Knowledge Work
Monkey Mind Knowledge WorkMonkey Mind Knowledge Work
Monkey Mind Knowledge WorkJabe Bloom
 
Lean agile scotland 2013
Lean agile scotland 2013Lean agile scotland 2013
Lean agile scotland 2013Jabe Bloom
 
Speed design studio version4.6
Speed design studio version4.6Speed design studio version4.6
Speed design studio version4.6Jabe Bloom
 
Agile Winnipeg iteration 22
Agile Winnipeg iteration 22Agile Winnipeg iteration 22
Agile Winnipeg iteration 22Jabe Bloom
 
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13Jabe Bloom
 
Multi Hypothesis Design Studio
Multi Hypothesis Design StudioMulti Hypothesis Design Studio
Multi Hypothesis Design StudioJabe Bloom
 

Más de Jabe Bloom (8)

Three frames DevOpsDays ATL
Three frames DevOpsDays ATLThree frames DevOpsDays ATL
Three frames DevOpsDays ATL
 
Monkey Mind Knowledge Work
Monkey Mind Knowledge WorkMonkey Mind Knowledge Work
Monkey Mind Knowledge Work
 
Lean agile scotland 2013
Lean agile scotland 2013Lean agile scotland 2013
Lean agile scotland 2013
 
Speed design studio version4.6
Speed design studio version4.6Speed design studio version4.6
Speed design studio version4.6
 
Agile Winnipeg iteration 22
Agile Winnipeg iteration 22Agile Winnipeg iteration 22
Agile Winnipeg iteration 22
 
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
Approach Avoidance: Heuristics for modeling systems with Kanban : LKNA13
 
Multi Hypothesis Design Studio
Multi Hypothesis Design StudioMulti Hypothesis Design Studio
Multi Hypothesis Design Studio
 
LeanTX
LeanTXLeanTX
LeanTX
 

Último

Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 

Último (20)

Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 

Failing Well Agile 2013