SlideShare una empresa de Scribd logo
1 de 27
Descargar para leer sin conexión
Testing beyond user experience
Stephen Pavlovich
Conversion.com
@pav
Success is a result of
the choices we make
Using experimentation to
solve complex problems
Experimentation lets us
challenge assumptions with
radical concepts
Nothing is new.
Everything is changing.
Test your servants for ten days. Let us be given vegetables to eat
and water to drink. Then let our appearance and the appearance of
the youths who eat the king’s food be observed by you, and deal
with your servants according to what you see.
“
”Daniel 1:12–13
If we can hypothesise,
analyse and iterate,
we can experiment
We know that quant and qual data.
We believe that lever for audience will result in goal.
We’ll know by testing test concept on area and
observing KPI for duration.
conversion.com/hypothesis
We know that quant and qual data.
We believe that lever for audience will result in goal.
We’ll know by testing test concept on area and
observing KPI for duration.
conversion.com/hypothesis
Apply toanything
@pav
@pav
@pav
@pav
In a fast-changing world
experimentation is our
unfair advantage

Más contenido relacionado

Destacado (6)

Jeff Sauer - Attribution is Bullshit
Jeff Sauer - Attribution is BullshitJeff Sauer - Attribution is Bullshit
Jeff Sauer - Attribution is Bullshit
 
Andre Morys the magic of combining neuromarketing & data sciences
Andre Morys   the magic of combining neuromarketing & data sciencesAndre Morys   the magic of combining neuromarketing & data sciences
Andre Morys the magic of combining neuromarketing & data sciences
 
Sujan Patel - Content as a Growth Machine
Sujan Patel - Content as a Growth MachineSujan Patel - Content as a Growth Machine
Sujan Patel - Content as a Growth Machine
 
Els Aerts - Advanced User Research
Els Aerts - Advanced User ResearchEls Aerts - Advanced User Research
Els Aerts - Advanced User Research
 
Christoph Luetke Schelhowe - Data for Everyone
Christoph Luetke Schelhowe  - Data for EveryoneChristoph Luetke Schelhowe  - Data for Everyone
Christoph Luetke Schelhowe - Data for Everyone
 
Digital marketing by numbers
Digital marketing by numbersDigital marketing by numbers
Digital marketing by numbers
 

Similar a Stephen Pavlovich - Testing Beyond the User Experience (6)

Research design
Research designResearch design
Research design
 
Rapid Cycle Improvement 2009
Rapid Cycle Improvement 2009Rapid Cycle Improvement 2009
Rapid Cycle Improvement 2009
 
Persuasion - three sure fire psychological tactics to boost your sales - Step...
Persuasion - three sure fire psychological tactics to boost your sales - Step...Persuasion - three sure fire psychological tactics to boost your sales - Step...
Persuasion - three sure fire psychological tactics to boost your sales - Step...
 
Vango- Business Resaerch Methods
Vango- Business Resaerch MethodsVango- Business Resaerch Methods
Vango- Business Resaerch Methods
 
GENEWIZ Brandbook
GENEWIZ BrandbookGENEWIZ Brandbook
GENEWIZ Brandbook
 
The Missing Piece between Discovery and Execution
The Missing Piece between Discovery and ExecutionThe Missing Piece between Discovery and Execution
The Missing Piece between Discovery and Execution
 

Más de CXL

Más de CXL (18)

How to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel PersonalizationHow to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel Personalization
 
Changing the Game: Always On Testing with Artificial Intelligence
Changing the Game: Always On Testing with Artificial IntelligenceChanging the Game: Always On Testing with Artificial Intelligence
Changing the Game: Always On Testing with Artificial Intelligence
 
How Eye Tracking Research Helps You Run Better A/B Tests
How Eye Tracking Research Helps You Run Better A/B TestsHow Eye Tracking Research Helps You Run Better A/B Tests
How Eye Tracking Research Helps You Run Better A/B Tests
 
[Elite Camp 2016] Karsten Lund - Master the Moment of Decision
[Elite Camp 2016] Karsten Lund - Master the Moment of Decision[Elite Camp 2016] Karsten Lund - Master the Moment of Decision
[Elite Camp 2016] Karsten Lund - Master the Moment of Decision
 
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
 
[Elite Camp 2016] Thomas Barker - From Zero to In-House Optimisation Superstars
[Elite Camp 2016] Thomas Barker - From Zero to In-House Optimisation Superstars[Elite Camp 2016] Thomas Barker - From Zero to In-House Optimisation Superstars
[Elite Camp 2016] Thomas Barker - From Zero to In-House Optimisation Superstars
 
[Elite Camp 2016] Yehoshua Coren - Strategic And Tactical Implementation And ...
[Elite Camp 2016] Yehoshua Coren - Strategic And Tactical Implementation And ...[Elite Camp 2016] Yehoshua Coren - Strategic And Tactical Implementation And ...
[Elite Camp 2016] Yehoshua Coren - Strategic And Tactical Implementation And ...
 
[Elite Camp 2016] Chris Mercer - How Top Marketers Are Using Google Tag Mana...
[Elite Camp 2016]  Chris Mercer - How Top Marketers Are Using Google Tag Mana...[Elite Camp 2016]  Chris Mercer - How Top Marketers Are Using Google Tag Mana...
[Elite Camp 2016] Chris Mercer - How Top Marketers Are Using Google Tag Mana...
 
[Elite Camp 2016] Martijn Scheijbeler - Optimization for Content Sites
[Elite Camp 2016] Martijn Scheijbeler - Optimization for Content Sites[Elite Camp 2016] Martijn Scheijbeler - Optimization for Content Sites
[Elite Camp 2016] Martijn Scheijbeler - Optimization for Content Sites
 
[Elite Camp 2016] Mogens Møller - How To Compete Against The Big Ones (Zaland...
[Elite Camp 2016] Mogens Møller - How To Compete Against The Big Ones (Zaland...[Elite Camp 2016] Mogens Møller - How To Compete Against The Big Ones (Zaland...
[Elite Camp 2016] Mogens Møller - How To Compete Against The Big Ones (Zaland...
 
[Elite Camp 2016] Johnathan Dane - The PPC Thermometer - Why You Should Care ...
[Elite Camp 2016] Johnathan Dane - The PPC Thermometer - Why You Should Care ...[Elite Camp 2016] Johnathan Dane - The PPC Thermometer - Why You Should Care ...
[Elite Camp 2016] Johnathan Dane - The PPC Thermometer - Why You Should Care ...
 
[Elite Camp 2016] Phil Nottingham - CRO with Video: Tips, Tricks and Tactics
[Elite Camp 2016] Phil Nottingham - CRO with Video: Tips, Tricks and Tactics[Elite Camp 2016] Phil Nottingham - CRO with Video: Tips, Tricks and Tactics
[Elite Camp 2016] Phil Nottingham - CRO with Video: Tips, Tricks and Tactics
 
[Elite Camp 2016] Stacey MacNaught - Nobody Pays the Bills in "Social Shares"...
[Elite Camp 2016] Stacey MacNaught - Nobody Pays the Bills in "Social Shares"...[Elite Camp 2016] Stacey MacNaught - Nobody Pays the Bills in "Social Shares"...
[Elite Camp 2016] Stacey MacNaught - Nobody Pays the Bills in "Social Shares"...
 
[Elite Camp 2016] Nilan Peiris Product == People
[Elite Camp 2016] Nilan Peiris Product == People[Elite Camp 2016] Nilan Peiris Product == People
[Elite Camp 2016] Nilan Peiris Product == People
 
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
 
[Elite Camp 2016] Marie Polli - Taking Your Customers on a Journey That Match...
[Elite Camp 2016] Marie Polli - Taking Your Customers on a Journey That Match...[Elite Camp 2016] Marie Polli - Taking Your Customers on a Journey That Match...
[Elite Camp 2016] Marie Polli - Taking Your Customers on a Journey That Match...
 
[Elite Camp 2016] Annemarie Klaassen & Tom van de Berg - Moving Beyond Testin...
[Elite Camp 2016] Annemarie Klaassen & Tom van de Berg - Moving Beyond Testin...[Elite Camp 2016] Annemarie Klaassen & Tom van de Berg - Moving Beyond Testin...
[Elite Camp 2016] Annemarie Klaassen & Tom van de Berg - Moving Beyond Testin...
 
[Elite Camp 2016] Amy Harrison - The Science of Screenwriting for Online Mark...
[Elite Camp 2016] Amy Harrison - The Science of Screenwriting for Online Mark...[Elite Camp 2016] Amy Harrison - The Science of Screenwriting for Online Mark...
[Elite Camp 2016] Amy Harrison - The Science of Screenwriting for Online Mark...
 

Último

Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
amitlee9823
 
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
amitlee9823
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
amitlee9823
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
AroojKhan71
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
amitlee9823
 
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
amitlee9823
 
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 

Último (20)

Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interaction
 
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Predicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science ProjectPredicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science Project
 
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
 
VidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxVidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptx
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
 
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signals
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 

Stephen Pavlovich - Testing Beyond the User Experience

  • 1. Testing beyond user experience Stephen Pavlovich Conversion.com @pav
  • 2.
  • 3.
  • 4. Success is a result of the choices we make
  • 5.
  • 6.
  • 7.
  • 8.
  • 10.
  • 11. Experimentation lets us challenge assumptions with radical concepts
  • 13.
  • 14. Test your servants for ten days. Let us be given vegetables to eat and water to drink. Then let our appearance and the appearance of the youths who eat the king’s food be observed by you, and deal with your servants according to what you see. “ ”Daniel 1:12–13
  • 15. If we can hypothesise, analyse and iterate, we can experiment
  • 16. We know that quant and qual data. We believe that lever for audience will result in goal. We’ll know by testing test concept on area and observing KPI for duration. conversion.com/hypothesis
  • 17. We know that quant and qual data. We believe that lever for audience will result in goal. We’ll know by testing test concept on area and observing KPI for duration. conversion.com/hypothesis Apply toanything
  • 18. @pav
  • 19. @pav
  • 20. @pav
  • 21. @pav
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27. In a fast-changing world experimentation is our unfair advantage