SlideShare una empresa de Scribd logo
1 de 44
Website Testing
Wins!
Championing testing to improve the
customer experience (and your bottom line)
Joanne Richardson
Thursday 17th October 2013
Hi!
I’m Joanne
What to expect today
Why test?

An introduction to the testing toolkit

When to test

What’s stopping you?

Time for questions
Why test?
H.I.P.P.O
Analytics
demonstrates a
problem
Balancing act

Happy
customers

Achieve
business
goals
The testing
toolkit
One-to-One Usability testing
One-to-One Usability testing
Guerilla Usability testing

“

The importance of recruiting
representative users is overrated.
... it’s much more important to test
early and often.
Steve Krug

”
Online usability testing
Eye tracking

1

2
4

3

5
6

7
Online design feedback
5 second test
5 Second Test example
5 Second Test results

Based on your first impression, would you
trust the information on this website?

?
5 Second Test results

Based on your first impression, would you
trust the information on this website?
5 Second Test results
Did you see any means of
enquiring with the company?

?
5 Second Test results
Did you see any means of
enquiring with the company?
5 Second Test results
Undercover testing

http://www.flickr.com/photos/paulbw/
Heatmaps
A/B & MVT Testing
A/B & MVT Testing
WINNER!
Version C:

30% increase in
conversion rate
A/B & MVT Testing
Version A:

Version B:
No winner
MVT Testing example

Orange + Orange

Button colours

Buy Direct”

Button labels

VS

VS

Green + Orange

“Buy from Philips”

= 4 combinations
Combo 1

Combo 3

Combo 2

Combo 4
WINNER!
Winning
combination:
Orange + Orange
with “Buy Philips”

x6 the number
of orders placed
x5 the number of people
clicking “Find retailers”
When to test
When to test in your project

Before

Your project

Usability testing &
undercover testing:

•Learn from current website
•Learn from competitors

Remote testing &
iterative usability testing
on sketches, wireframes
and visual designs

After

Usability testing to verify
A/B & MVT testing to
refine and optimise
When to test in your project

Before

Usability testing &
undercover testing:

•Learn from current website
•Learn from competitors

Your project

Remote testing &
iterative usability testing
on sketches, wireframes
and visual designs

After

Usability testing to verify
A/B & MVT testing to
refine and optimise
When to test in your project

Before

Usability testing &
undercover testing:

•Learn from current website
•Learn from competitors

Your project

Remote testing &
iterative usability testing
on sketches, wireframes
and visual designs

After

Usability testing to verify
A/B & MVT testing to
refine and optimise
What’s
stopping you?
Getting buy in
Ways to get buy in...
Results = Buy in
Let the stats speak
for themselves

35% dropout at
the last step
626 orders lost
£125,200
every month
Bring in an outside consultant

(other agencies are available)
Continue to get buy in...
Make it measurable!
Examples of what to measure:
eCommerce

Engagement

Number of transactions

Key goals

Revenue
Average Order Value
Order frequency
Conversion rate

- Registration, log in, newsletter sign up
Micro-conversions
- Download a PDF, check their balance
Churn
- How many users/registrations do you loose a
month/year?
Usability test benchmarks
- How long does it take to complete a task?
Shout about success
To sum up today
Test as early and as often as your budget allows
Select your toolkit (or use an agency which has a great
one)
Make it measurable
Shout about it!
Time for
questions
• @joanne84
• joanne@orangebus.co.uk
• www.orangebus.co.uk
• @orangebus

Más contenido relacionado

La actualidad más candente

A/B Mythbusters: Common Optimization Objections Debunked
A/B Mythbusters: Common Optimization Objections DebunkedA/B Mythbusters: Common Optimization Objections Debunked
A/B Mythbusters: Common Optimization Objections DebunkedOptimizely
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely
 
Finding The Agile Sweet Spot
Finding The Agile Sweet SpotFinding The Agile Sweet Spot
Finding The Agile Sweet SpotCharles Husemann
 
Building High-Growth Products with Jobs-to-be-Done
Building High-Growth Products with Jobs-to-be-DoneBuilding High-Growth Products with Jobs-to-be-Done
Building High-Growth Products with Jobs-to-be-DoneProduct School
 
Enterprise JavaScript Error Handling (Ajax Experience 2008)
Enterprise JavaScript Error Handling (Ajax Experience 2008)Enterprise JavaScript Error Handling (Ajax Experience 2008)
Enterprise JavaScript Error Handling (Ajax Experience 2008)Nicholas Zakas
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B TestingJanessa Lantz
 
Nancy's webinar
Nancy's webinarNancy's webinar
Nancy's webinarVWO
 
Workshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization CultureWorkshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization CultureOptimizely
 
Improve your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B TestingImprove your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B Testingintrotodigital
 
DIY Website Usability Testing
DIY Website Usability TestingDIY Website Usability Testing
DIY Website Usability TestingSteve Martin
 
A/B Testing Framework Design
A/B Testing Framework DesignA/B Testing Framework Design
A/B Testing Framework DesignPatrick McKenzie
 
Modeling Requirements Using Examples
Modeling Requirements Using ExamplesModeling Requirements Using Examples
Modeling Requirements Using ExamplesExcella
 
Don't do anything on your website you wouldn't do on a first date
Don't do anything on your website you wouldn't do on a first dateDon't do anything on your website you wouldn't do on a first date
Don't do anything on your website you wouldn't do on a first dateAGConsult
 
Tech Trends to Look Out For in the Next 5 Years by Amazon Sr PM
Tech Trends to Look Out For in the Next 5 Years by Amazon Sr PMTech Trends to Look Out For in the Next 5 Years by Amazon Sr PM
Tech Trends to Look Out For in the Next 5 Years by Amazon Sr PMProduct School
 
Guerilla Usability Testing
Guerilla Usability TestingGuerilla Usability Testing
Guerilla Usability TestingAndy Budd
 
Apply A/B Testing with NGINX Routing Policy
Apply A/B Testing with NGINX Routing PolicyApply A/B Testing with NGINX Routing Policy
Apply A/B Testing with NGINX Routing PolicySupachai Jaturaprom
 
AI Models For Fun and Profit by Walmart Director of Artificial Intelligence
AI Models For Fun and Profit by Walmart Director of Artificial IntelligenceAI Models For Fun and Profit by Walmart Director of Artificial Intelligence
AI Models For Fun and Profit by Walmart Director of Artificial IntelligenceProduct School
 
2008 09 06 Eric Ries Haas Columbia Customer Development Engineering
2008 09 06 Eric Ries Haas Columbia Customer Development Engineering2008 09 06 Eric Ries Haas Columbia Customer Development Engineering
2008 09 06 Eric Ries Haas Columbia Customer Development Engineeringguest472f47
 
Lean Software Development: Validated Learning
Lean Software Development: Validated LearningLean Software Development: Validated Learning
Lean Software Development: Validated LearningÒscar Vilaplana
 

La actualidad más candente (20)

A/B Mythbusters: Common Optimization Objections Debunked
A/B Mythbusters: Common Optimization Objections DebunkedA/B Mythbusters: Common Optimization Objections Debunked
A/B Mythbusters: Common Optimization Objections Debunked
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation Roadmap
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
 
Finding The Agile Sweet Spot
Finding The Agile Sweet SpotFinding The Agile Sweet Spot
Finding The Agile Sweet Spot
 
Building High-Growth Products with Jobs-to-be-Done
Building High-Growth Products with Jobs-to-be-DoneBuilding High-Growth Products with Jobs-to-be-Done
Building High-Growth Products with Jobs-to-be-Done
 
Enterprise JavaScript Error Handling (Ajax Experience 2008)
Enterprise JavaScript Error Handling (Ajax Experience 2008)Enterprise JavaScript Error Handling (Ajax Experience 2008)
Enterprise JavaScript Error Handling (Ajax Experience 2008)
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing
 
Nancy's webinar
Nancy's webinarNancy's webinar
Nancy's webinar
 
Workshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization CultureWorkshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization Culture
 
Improve your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B TestingImprove your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B Testing
 
DIY Website Usability Testing
DIY Website Usability TestingDIY Website Usability Testing
DIY Website Usability Testing
 
A/B Testing Framework Design
A/B Testing Framework DesignA/B Testing Framework Design
A/B Testing Framework Design
 
Modeling Requirements Using Examples
Modeling Requirements Using ExamplesModeling Requirements Using Examples
Modeling Requirements Using Examples
 
Don't do anything on your website you wouldn't do on a first date
Don't do anything on your website you wouldn't do on a first dateDon't do anything on your website you wouldn't do on a first date
Don't do anything on your website you wouldn't do on a first date
 
Tech Trends to Look Out For in the Next 5 Years by Amazon Sr PM
Tech Trends to Look Out For in the Next 5 Years by Amazon Sr PMTech Trends to Look Out For in the Next 5 Years by Amazon Sr PM
Tech Trends to Look Out For in the Next 5 Years by Amazon Sr PM
 
Guerilla Usability Testing
Guerilla Usability TestingGuerilla Usability Testing
Guerilla Usability Testing
 
Apply A/B Testing with NGINX Routing Policy
Apply A/B Testing with NGINX Routing PolicyApply A/B Testing with NGINX Routing Policy
Apply A/B Testing with NGINX Routing Policy
 
AI Models For Fun and Profit by Walmart Director of Artificial Intelligence
AI Models For Fun and Profit by Walmart Director of Artificial IntelligenceAI Models For Fun and Profit by Walmart Director of Artificial Intelligence
AI Models For Fun and Profit by Walmart Director of Artificial Intelligence
 
2008 09 06 Eric Ries Haas Columbia Customer Development Engineering
2008 09 06 Eric Ries Haas Columbia Customer Development Engineering2008 09 06 Eric Ries Haas Columbia Customer Development Engineering
2008 09 06 Eric Ries Haas Columbia Customer Development Engineering
 
Lean Software Development: Validated Learning
Lean Software Development: Validated LearningLean Software Development: Validated Learning
Lean Software Development: Validated Learning
 

Destacado

10 UX Changes for Every Drupal Site
10 UX Changes for Every Drupal Site10 UX Changes for Every Drupal Site
10 UX Changes for Every Drupal SiteVicky Teinaki
 
Increasing online conversion through persuasive design
Increasing online conversion through persuasive designIncreasing online conversion through persuasive design
Increasing online conversion through persuasive designJoanne Rigby (Richardson)
 
A/B Testing and the Infinite Monkey Theory
A/B Testing and the Infinite Monkey TheoryA/B Testing and the Infinite Monkey Theory
A/B Testing and the Infinite Monkey TheoryUseItBetter
 
MozCon 2016! Mind Games: Craft Killer Experiences with 7 Lessons from Cogniti...
MozCon 2016! Mind Games: Craft Killer Experiences with 7 Lessons from Cogniti...MozCon 2016! Mind Games: Craft Killer Experiences with 7 Lessons from Cogniti...
MozCon 2016! Mind Games: Craft Killer Experiences with 7 Lessons from Cogniti...Sarah Weise
 
Understand A/B Testing in 9 use cases & 7 mistakes
Understand A/B Testing in 9 use cases & 7 mistakesUnderstand A/B Testing in 9 use cases & 7 mistakes
Understand A/B Testing in 9 use cases & 7 mistakesTheFamily
 
Seriously Advanced A/B Testing by Wyatt Jenkins
Seriously Advanced A/B Testing	by Wyatt JenkinsSeriously Advanced A/B Testing	by Wyatt Jenkins
Seriously Advanced A/B Testing by Wyatt JenkinsLean Startup Co.
 
10 A/B Testing Mistakes that Make Your Wallet Cry
10 A/B Testing Mistakes that Make Your Wallet Cry10 A/B Testing Mistakes that Make Your Wallet Cry
10 A/B Testing Mistakes that Make Your Wallet CryConvert.com
 
Teaching Students with Emojis, Emoticons, & Textspeak
Teaching Students with Emojis, Emoticons, & TextspeakTeaching Students with Emojis, Emoticons, & Textspeak
Teaching Students with Emojis, Emoticons, & TextspeakShelly Sanchez Terrell
 
Study: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving CarsStudy: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving CarsLinkedIn
 
UX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesUX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesNed Potter
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with DataSeth Familian
 
3 Things Every Sales Team Needs to Be Thinking About in 2017
3 Things Every Sales Team Needs to Be Thinking About in 20173 Things Every Sales Team Needs to Be Thinking About in 2017
3 Things Every Sales Team Needs to Be Thinking About in 2017Drift
 

Destacado (15)

10 UX Changes for Every Drupal Site
10 UX Changes for Every Drupal Site10 UX Changes for Every Drupal Site
10 UX Changes for Every Drupal Site
 
Increasing online conversion through persuasive design
Increasing online conversion through persuasive designIncreasing online conversion through persuasive design
Increasing online conversion through persuasive design
 
A/B Testing and the Infinite Monkey Theory
A/B Testing and the Infinite Monkey TheoryA/B Testing and the Infinite Monkey Theory
A/B Testing and the Infinite Monkey Theory
 
Android design in action
Android design in actionAndroid design in action
Android design in action
 
MozCon 2016! Mind Games: Craft Killer Experiences with 7 Lessons from Cogniti...
MozCon 2016! Mind Games: Craft Killer Experiences with 7 Lessons from Cogniti...MozCon 2016! Mind Games: Craft Killer Experiences with 7 Lessons from Cogniti...
MozCon 2016! Mind Games: Craft Killer Experiences with 7 Lessons from Cogniti...
 
A day in the life of a ux designer
A day in the life of a ux designerA day in the life of a ux designer
A day in the life of a ux designer
 
Understand A/B Testing in 9 use cases & 7 mistakes
Understand A/B Testing in 9 use cases & 7 mistakesUnderstand A/B Testing in 9 use cases & 7 mistakes
Understand A/B Testing in 9 use cases & 7 mistakes
 
Seriously Advanced A/B Testing by Wyatt Jenkins
Seriously Advanced A/B Testing	by Wyatt JenkinsSeriously Advanced A/B Testing	by Wyatt Jenkins
Seriously Advanced A/B Testing by Wyatt Jenkins
 
Proto-persona workshop UX Scotland 2016
Proto-persona workshop UX Scotland 2016 Proto-persona workshop UX Scotland 2016
Proto-persona workshop UX Scotland 2016
 
10 A/B Testing Mistakes that Make Your Wallet Cry
10 A/B Testing Mistakes that Make Your Wallet Cry10 A/B Testing Mistakes that Make Your Wallet Cry
10 A/B Testing Mistakes that Make Your Wallet Cry
 
Teaching Students with Emojis, Emoticons, & Textspeak
Teaching Students with Emojis, Emoticons, & TextspeakTeaching Students with Emojis, Emoticons, & Textspeak
Teaching Students with Emojis, Emoticons, & Textspeak
 
Study: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving CarsStudy: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving Cars
 
UX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesUX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and Archives
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with Data
 
3 Things Every Sales Team Needs to Be Thinking About in 2017
3 Things Every Sales Team Needs to Be Thinking About in 20173 Things Every Sales Team Needs to Be Thinking About in 2017
3 Things Every Sales Team Needs to Be Thinking About in 2017
 

Similar a Website Testing WINS!

Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality productCarmen Brion
 
Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Remote v Moderated Usability Testing - by Paul Rouke from PRWDRemote v Moderated Usability Testing - by Paul Rouke from PRWD
Remote v Moderated Usability Testing - by Paul Rouke from PRWDBecome Customer-Centric
 
How Truly Effective CRO Requires Great UX
How Truly Effective CRO Requires Great UXHow Truly Effective CRO Requires Great UX
How Truly Effective CRO Requires Great UXGiles Thomas
 
Hiten Shah, KISSmetrics - Warm Gun conference
Hiten Shah, KISSmetrics - Warm Gun conferenceHiten Shah, KISSmetrics - Warm Gun conference
Hiten Shah, KISSmetrics - Warm Gun conference500 Startups
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfVWO
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMProduct School
 
Conversion Rate Optimization for Business Growth
Conversion Rate Optimization for Business GrowthConversion Rate Optimization for Business Growth
Conversion Rate Optimization for Business GrowthReapDigital
 
230286802015PPT.pptx
230286802015PPT.pptx230286802015PPT.pptx
230286802015PPT.pptxannalakshmi35
 
Building a Product Strategy by Microsoft Sr PM
Building a Product Strategy by Microsoft Sr PMBuilding a Product Strategy by Microsoft Sr PM
Building a Product Strategy by Microsoft Sr PMProduct School
 
Leverage The Power of Small Data
Leverage The Power of Small DataLeverage The Power of Small Data
Leverage The Power of Small DataKaryn Zuidinga
 
Building a Product Strategy by Microsoft Sr PM
Building a Product Strategy by Microsoft Sr PMBuilding a Product Strategy by Microsoft Sr PM
Building a Product Strategy by Microsoft Sr PMProduct School
 
How Eye Tracking Research Helps You Run Better A/B Tests
How Eye Tracking Research Helps You Run Better A/B TestsHow Eye Tracking Research Helps You Run Better A/B Tests
How Eye Tracking Research Helps You Run Better A/B TestsCXL
 
3 Steps To Improving Your Online Performance
3 Steps To Improving Your Online Performance3 Steps To Improving Your Online Performance
3 Steps To Improving Your Online PerformanceBecome Customer-Centric
 
Metrics that Matter
Metrics that MatterMetrics that Matter
Metrics that MatterJeremy Horn
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth StackOptimizely
 
Presentations - Zarget CRO meetup 2017
Presentations - Zarget CRO meetup 2017Presentations - Zarget CRO meetup 2017
Presentations - Zarget CRO meetup 2017ZargetHQ
 
Data - How to Use it & When by Square and Call Rail Product Leader
Data - How to Use it & When by Square and Call Rail Product LeaderData - How to Use it & When by Square and Call Rail Product Leader
Data - How to Use it & When by Square and Call Rail Product LeaderProduct School
 
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'Emma Mirrington
 
Usability Testing for Developers with No Budget
Usability Testing for Developers with No BudgetUsability Testing for Developers with No Budget
Usability Testing for Developers with No BudgetAshley Dzick
 

Similar a Website Testing WINS! (20)

Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Remote v Moderated Usability Testing - by Paul Rouke from PRWDRemote v Moderated Usability Testing - by Paul Rouke from PRWD
Remote v Moderated Usability Testing - by Paul Rouke from PRWD
 
How Truly Effective CRO Requires Great UX
How Truly Effective CRO Requires Great UXHow Truly Effective CRO Requires Great UX
How Truly Effective CRO Requires Great UX
 
Hiten Shah, KISSmetrics - Warm Gun conference
Hiten Shah, KISSmetrics - Warm Gun conferenceHiten Shah, KISSmetrics - Warm Gun conference
Hiten Shah, KISSmetrics - Warm Gun conference
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
 
Product-led growth
Product-led growthProduct-led growth
Product-led growth
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
 
Conversion Rate Optimization for Business Growth
Conversion Rate Optimization for Business GrowthConversion Rate Optimization for Business Growth
Conversion Rate Optimization for Business Growth
 
230286802015PPT.pptx
230286802015PPT.pptx230286802015PPT.pptx
230286802015PPT.pptx
 
Building a Product Strategy by Microsoft Sr PM
Building a Product Strategy by Microsoft Sr PMBuilding a Product Strategy by Microsoft Sr PM
Building a Product Strategy by Microsoft Sr PM
 
Leverage The Power of Small Data
Leverage The Power of Small DataLeverage The Power of Small Data
Leverage The Power of Small Data
 
Building a Product Strategy by Microsoft Sr PM
Building a Product Strategy by Microsoft Sr PMBuilding a Product Strategy by Microsoft Sr PM
Building a Product Strategy by Microsoft Sr PM
 
How Eye Tracking Research Helps You Run Better A/B Tests
How Eye Tracking Research Helps You Run Better A/B TestsHow Eye Tracking Research Helps You Run Better A/B Tests
How Eye Tracking Research Helps You Run Better A/B Tests
 
3 Steps To Improving Your Online Performance
3 Steps To Improving Your Online Performance3 Steps To Improving Your Online Performance
3 Steps To Improving Your Online Performance
 
Metrics that Matter
Metrics that MatterMetrics that Matter
Metrics that Matter
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
 
Presentations - Zarget CRO meetup 2017
Presentations - Zarget CRO meetup 2017Presentations - Zarget CRO meetup 2017
Presentations - Zarget CRO meetup 2017
 
Data - How to Use it & When by Square and Call Rail Product Leader
Data - How to Use it & When by Square and Call Rail Product LeaderData - How to Use it & When by Square and Call Rail Product Leader
Data - How to Use it & When by Square and Call Rail Product Leader
 
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
 
Usability Testing for Developers with No Budget
Usability Testing for Developers with No BudgetUsability Testing for Developers with No Budget
Usability Testing for Developers with No Budget
 

Último

Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...Yantram Animation Studio Corporation
 
PORTAFOLIO 2024_ ANASTASIYA KUDINOVA
PORTAFOLIO   2024_  ANASTASIYA  KUDINOVAPORTAFOLIO   2024_  ANASTASIYA  KUDINOVA
PORTAFOLIO 2024_ ANASTASIYA KUDINOVAAnastasiya Kudinova
 
Design and Managing Service in the field of tourism and hospitality industry
Design and Managing Service in the field of tourism and hospitality industryDesign and Managing Service in the field of tourism and hospitality industry
Design and Managing Service in the field of tourism and hospitality industryrioverosanniejoy
 
办理(麻省罗威尔毕业证书)美国麻省大学罗威尔校区毕业证成绩单原版一比一
办理(麻省罗威尔毕业证书)美国麻省大学罗威尔校区毕业证成绩单原版一比一办理(麻省罗威尔毕业证书)美国麻省大学罗威尔校区毕业证成绩单原版一比一
办理(麻省罗威尔毕业证书)美国麻省大学罗威尔校区毕业证成绩单原版一比一diploma 1
 
1比1办理美国北卡罗莱纳州立大学毕业证成绩单pdf电子版制作修改
1比1办理美国北卡罗莱纳州立大学毕业证成绩单pdf电子版制作修改1比1办理美国北卡罗莱纳州立大学毕业证成绩单pdf电子版制作修改
1比1办理美国北卡罗莱纳州立大学毕业证成绩单pdf电子版制作修改yuu sss
 
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证nhjeo1gg
 
Dubai Calls Girl Tapes O525547819 Real Tapes Escort Services Dubai
Dubai Calls Girl Tapes O525547819 Real Tapes Escort Services DubaiDubai Calls Girl Tapes O525547819 Real Tapes Escort Services Dubai
Dubai Calls Girl Tapes O525547819 Real Tapes Escort Services Dubaikojalkojal131
 
cda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptcda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptMaryamAfzal41
 
Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Rndexperts
 
MT. Marseille an Archipelago. Strategies for Integrating Residential Communit...
MT. Marseille an Archipelago. Strategies for Integrating Residential Communit...MT. Marseille an Archipelago. Strategies for Integrating Residential Communit...
MT. Marseille an Archipelago. Strategies for Integrating Residential Communit...katerynaivanenko1
 
Call Girls Meghani Nagar 7397865700 Independent Call Girls
Call Girls Meghani Nagar 7397865700  Independent Call GirlsCall Girls Meghani Nagar 7397865700  Independent Call Girls
Call Girls Meghani Nagar 7397865700 Independent Call Girlsssuser7cb4ff
 
group_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfgroup_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfneelspinoy
 
办理(USYD毕业证书)澳洲悉尼大学毕业证成绩单原版一比一
办理(USYD毕业证书)澳洲悉尼大学毕业证成绩单原版一比一办理(USYD毕业证书)澳洲悉尼大学毕业证成绩单原版一比一
办理(USYD毕业证书)澳洲悉尼大学毕业证成绩单原版一比一diploma 1
 
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts ServiceCall Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Servicejennyeacort
 
ARt app | UX Case Study
ARt app | UX Case StudyARt app | UX Case Study
ARt app | UX Case StudySophia Viganò
 
韩国SKKU学位证,成均馆大学毕业证书1:1制作
韩国SKKU学位证,成均馆大学毕业证书1:1制作韩国SKKU学位证,成均馆大学毕业证书1:1制作
韩国SKKU学位证,成均馆大学毕业证书1:1制作7tz4rjpd
 
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...mrchrns005
 
西北大学毕业证学位证成绩单-怎么样办伪造
西北大学毕业证学位证成绩单-怎么样办伪造西北大学毕业证学位证成绩单-怎么样办伪造
西北大学毕业证学位证成绩单-怎么样办伪造kbdhl05e
 
306MTAMount UCLA University Bachelor's Diploma in Social Media
306MTAMount UCLA University Bachelor's Diploma in Social Media306MTAMount UCLA University Bachelor's Diploma in Social Media
306MTAMount UCLA University Bachelor's Diploma in Social MediaD SSS
 
办理学位证加州州立大学洛杉矶分校毕业证成绩单原版一比一
办理学位证加州州立大学洛杉矶分校毕业证成绩单原版一比一办理学位证加州州立大学洛杉矶分校毕业证成绩单原版一比一
办理学位证加州州立大学洛杉矶分校毕业证成绩单原版一比一Fi L
 

Último (20)

Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
 
PORTAFOLIO 2024_ ANASTASIYA KUDINOVA
PORTAFOLIO   2024_  ANASTASIYA  KUDINOVAPORTAFOLIO   2024_  ANASTASIYA  KUDINOVA
PORTAFOLIO 2024_ ANASTASIYA KUDINOVA
 
Design and Managing Service in the field of tourism and hospitality industry
Design and Managing Service in the field of tourism and hospitality industryDesign and Managing Service in the field of tourism and hospitality industry
Design and Managing Service in the field of tourism and hospitality industry
 
办理(麻省罗威尔毕业证书)美国麻省大学罗威尔校区毕业证成绩单原版一比一
办理(麻省罗威尔毕业证书)美国麻省大学罗威尔校区毕业证成绩单原版一比一办理(麻省罗威尔毕业证书)美国麻省大学罗威尔校区毕业证成绩单原版一比一
办理(麻省罗威尔毕业证书)美国麻省大学罗威尔校区毕业证成绩单原版一比一
 
1比1办理美国北卡罗莱纳州立大学毕业证成绩单pdf电子版制作修改
1比1办理美国北卡罗莱纳州立大学毕业证成绩单pdf电子版制作修改1比1办理美国北卡罗莱纳州立大学毕业证成绩单pdf电子版制作修改
1比1办理美国北卡罗莱纳州立大学毕业证成绩单pdf电子版制作修改
 
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
 
Dubai Calls Girl Tapes O525547819 Real Tapes Escort Services Dubai
Dubai Calls Girl Tapes O525547819 Real Tapes Escort Services DubaiDubai Calls Girl Tapes O525547819 Real Tapes Escort Services Dubai
Dubai Calls Girl Tapes O525547819 Real Tapes Escort Services Dubai
 
cda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptcda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis ppt
 
Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025
 
MT. Marseille an Archipelago. Strategies for Integrating Residential Communit...
MT. Marseille an Archipelago. Strategies for Integrating Residential Communit...MT. Marseille an Archipelago. Strategies for Integrating Residential Communit...
MT. Marseille an Archipelago. Strategies for Integrating Residential Communit...
 
Call Girls Meghani Nagar 7397865700 Independent Call Girls
Call Girls Meghani Nagar 7397865700  Independent Call GirlsCall Girls Meghani Nagar 7397865700  Independent Call Girls
Call Girls Meghani Nagar 7397865700 Independent Call Girls
 
group_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfgroup_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdf
 
办理(USYD毕业证书)澳洲悉尼大学毕业证成绩单原版一比一
办理(USYD毕业证书)澳洲悉尼大学毕业证成绩单原版一比一办理(USYD毕业证书)澳洲悉尼大学毕业证成绩单原版一比一
办理(USYD毕业证书)澳洲悉尼大学毕业证成绩单原版一比一
 
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts ServiceCall Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
 
ARt app | UX Case Study
ARt app | UX Case StudyARt app | UX Case Study
ARt app | UX Case Study
 
韩国SKKU学位证,成均馆大学毕业证书1:1制作
韩国SKKU学位证,成均馆大学毕业证书1:1制作韩国SKKU学位证,成均馆大学毕业证书1:1制作
韩国SKKU学位证,成均馆大学毕业证书1:1制作
 
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
 
西北大学毕业证学位证成绩单-怎么样办伪造
西北大学毕业证学位证成绩单-怎么样办伪造西北大学毕业证学位证成绩单-怎么样办伪造
西北大学毕业证学位证成绩单-怎么样办伪造
 
306MTAMount UCLA University Bachelor's Diploma in Social Media
306MTAMount UCLA University Bachelor's Diploma in Social Media306MTAMount UCLA University Bachelor's Diploma in Social Media
306MTAMount UCLA University Bachelor's Diploma in Social Media
 
办理学位证加州州立大学洛杉矶分校毕业证成绩单原版一比一
办理学位证加州州立大学洛杉矶分校毕业证成绩单原版一比一办理学位证加州州立大学洛杉矶分校毕业证成绩单原版一比一
办理学位证加州州立大学洛杉矶分校毕业证成绩单原版一比一
 

Website Testing WINS!

Notas del editor

  1. Hi i’m Joanne, I Head up the UX team at Orange Bus I’ve been a UX designer for 7 years experience - I’ve always been interested in research methods and the surprises that usability testing uncovers. - In more recent years i’ve been specialising in Conversion Optimisation for big clients such as Philips, ScS, and Sage.
  2. Today I wanted to explain the benefits of testing and showcase some of the Tools we use at Orange Bus throughout our projects and help you take the next steps to reap the benefits. For the purpose of today we’re going to focus on testing methods which inform or validate our design decisions
  3. So, Why test in the first place? We obviously have a mix of skills and experience in the room, but we all most likely impact the user experience at some point. Every day as professionals, we make educated decisions based on years of experience, knowledge and expertise which create the customer experience. So how can we be confident that our assumptions are correct? The truth is we can’t unless test with real end users and validate.
  4. I’m sure everyone has come across this. Sometimes we even find this internally that we’ll have conflicting opinions which are equally valid. So, how can we resolve the issue and know we’re doing the right thing?
  5. And if you’re like me and like delving into the analytics then you can often see where there is a problem, such as people dropping out of a registration process. But you have no idea why there is a problem unless you test with real end users.
  6. As a UX designer your job is to balance the needs of the audience and the business goals you’ve been tasked with achieving. Testing provides a measurable, validated way to improve both.
  7. There are many testing tools and methods out there once you start looking around so today i’m going to showcase some of the tools we love to use at Orange Bus throughout our projects.
  8. For anyone not familiar, one-to-one usability testing involves observing representative members of your audience in performing a series of tasks. They are also asked to “think out loud” to gather their thoughts and feedback while you observe their behaviour to understand their actions. What you can test Early prototypes, a live website Tools - Basically screen recorders which track the users mouse movement and and what they’re saying which allows you to watch back the sessions to get accurate feedback, make clips to demonstrate important feedback to your client or watch it back with participants to get their feedback on their actions. The main benefit of one-to-one testing is that it allows you to ask questions as you go to get to the heart of issues and ask for feedback on areas the participant has not explained. Negatives Recruitment can often be an issue and scheduling participants as many cannot make 9-5 and it is difficult to plan tests back to back.
  9. Highly recommend if you run usability tests yourself that you take part in someone elses to help put yourself in participants shoes. I was lucky enough to take part in Schuh’s usability test a few years ago and they combined other activities with the traditional usability test. One activity was to select from a table full of celebrities which I thought represented Schuh. It most likely didn’t matter which celebrity I picked, it was more the reasons why i thought the represented the brand to get key descriptive words out of me. Over the years i’ve really learnt from this and we’ve had great success as Orange Bus in letting participants draw the page they’re about to see before the test. This lets them compare their expectation to their first impression and gets them talking and being descriptive straight away.
  10. I mentioned recruitment can be a costly and time intensive tasks, there is an offshoot to this type of testing which goes with the theory that you don’t need to recruit representative users. You will find most usability issues with just about anyone. It’s worth bearing in mind this is not always the case and you can get much more in depth feedback on your website copy from the target audience who may have previous knowledge or experience which impact their feedback.
  11. Time in turning round results and budget can often leave many clients believing testing is not an option in a project. At Orange Bus we would never recommend running no usability testing at all during your project as you’re leaving the project open to risk and a the end of the day we want the end result to be the best it can be. Online or remote usability testing allows you to easily recruit and gather real user feedback quite quickly to feed into your project. Using these tools, participants can walk through your tasks and provide verbal feedback whilst their screen is recorded. The only downside to this is that the test are unmoderated and you’re unable to ask questions to the participant to find out more information or details on a issue.
  12. Eye tracking uses sensors to track the participants eye movements during a usability test to see what catches their attention. You can then review these with the participant to get even more feedback on why a particular item drew their attention and how they feel about it.. It’s also great as you can test more than websites and prototypes like the other tools mentioned - you can test videos, tv ads and printed materials. However it is quite costly to purchase the equipment or rent a lab.
  13. All the tools mentioned work really well for prototypes and live websites, however its important to gather as much feedback as possible and as early as possible. That’s where testing on visuals designs can help validate decisions using these tools. UsabilityHub is probably the one we use the most to run two key tests. The left is an example where a visual has been uploaded an users have been asked to click on all the areas they believe are clickable. This helps us understand if your call to action styles are clear. Another test is 5 second tests where users are shown a page or email design for 5 seconds and then the image is taken away. It’s 5 seconds as this is typically the time it takes to make you’re initial first impression and choose to continue exploring a website or leave. They are then asked a series of questions about what stood out to them to help us understand first impressions and what stood out the most.
  14. We’ll do a quick example of a 5 second test. So i’ll show you a screen for around 5 seconds and we’ll answer some questions. ready?
  15. Moving onto what I like to call undercover testing, Clicktale runs on a live website and records every mouse movement a visitor makes allowing you to analyse samples of real suer behaviour. This is great as you can be confident that no-one has changed their behaviour as they may well do when being observed. The negatives are much like analytics, it won’t tell you why your audience may be performing the action of skipping a step, it can be very addictive to watch and time consuming and does have a cost implication.
  16. Heatmaps track visitors to your websites mouse movements. A lot of users test to read with their mouse pointer to it can be a good way of tracking your copy. Clicktale also does this, or if you just want heatmaps then crazy egg us a good tool.
  17. A/B testing allows us to put different versions of a page or page elements live to real users and see which performs the best against key goals/metrics. It’s great as it allows us to experiment and test different assumptions to find the solution which performs the best. Usability testing can often flag the areas we need to focus on and help generate different ideas to test. Optimizely and Visual website optimizer are paid for tools which provide a drag and drop interface with little CSS knowledge required to achieve simple changes. Which means you don't necessarily need development resource to test quick changes such as button labels and colours. Google content experiments is a free tool to everyone in Google Analytics, however its functionality is quite limited and you are required to build two versions of the page in order to test - this can often make this a costly and time consuming choice. All these tools will track your test and help you determine a winner and with after a bit of experience you can be confident in your results and roll out the winning version.
  18. A couple of quick examples. You can vote on this one. This is a A/B test we conducted for philips on their male grooming products website. we wanted to see if representing the price differently affected visits and sales on the Philips store.
  19. What’s your vote for a winner in the tab placement?
  20. Our assumption was that making the Philips call to action stand out more with different button colours would increase Philips sales and click throughs to the store. We also thought a more descriptive label “Buy from Philips” would convert much better.
  21. Moving on it can be difficult to know when to use these methods
  22. Before - Often a step which is missed. There is a lot which can be learnt from the current website which can feed into new requirements to ensure the same mistakes aren't made again and you keep essential features your audience love. - Usability testing on a competitors websites can equally help test features you do not have and gather feedback
  23. Changes during a project are more expensive as the projetc progresses, therefore its always best to test as early and often as your budget permits.
  24. Testing your website should never stop at the end of the project and if you have a relatively new website now is the time to fully understand your audience, optimise all your processes to they meet audience and business needs.
  25. Hopefully, that all sounds brilliant but why do most people not test?
  26. Number 1 barrier is getting buy in to start testing in the first place Im sure you can appreciate that the tools and methods mentioned are not free. They take time and resources to set up, manage, analyse and implement results. The tools themselves sometimes also carry a cost. During a project testing can often be seen as a delay and an unnecessary extra step - making it impossible to verify your decisions and know we’re doing a good job.
  27. The most obvious is to get the results and prove with impressive numbers and usability videos that testing really works. A way to get around this catch 22 situation are to make good use of free trials if you have the in house expertise (and time) to manage the tests, analyse and present their results.
  28. Look into analytics - highlight the problems you can see and showcase how testing can explain why these are an issue to help resolve them 626 x Avg order = £200 = £125,200
  29. If you don’t have the expertise or you don’t have the experience or resources then bring in an agency to showcase their case studies and walk through stakeholders the importance of testing
  30. To continue to get buy in you need to show results. Before you start make sure you know what success looks like and make sure you’re measuring the impact your changes have made either through analytics or a separate tool.
  31. Sharable reports which sum up the highlights blog posts articles
  32. That’ all sounds brilliant but why do most people not test?