SlideShare a Scribd company logo
1 of 11
A/B Testing
Make your wildest conversion goals come true!
08 Obama Campaign
Test Media
Test Button Text
The
Winner
• Sign up rate improved from 8.26% to 11.6% — 40.6% more
• 2,880,000 of the 10 million signs up from that change
• 10% of sign ups become volunteers — 280K more
• Each address worth $21 in donations — $60 million more
A/B Tools
• Nelio A/B Testing (http://wp-abtesting.com)
• Visual Website Optimizer (https://vwo.com)
• Optimizely (http://www.optimizely.com)
• AB Press Optimizer plugin
(http://abpressoptimizer.com)
• Google Analytics — they have split testing
Where To Test
• Top landing pages
• Top 5 bounce rate pages
• Exit points in your conversion funnel
• Most valuable pages for income
First 10 Tests
• 4 Message tests — Headings
• 2 Large design changes
• 4 Aha moments — look for points where your
expecting your customer to understand your
product.
Let’s Experiment!
Results
• You need at least 100 visitors per variation and
25 conversions per variation. More are better.
• The longer a test runs, the more accurate the
results will be.
• If you have a low traffic site, this isn’t a tool for
you just yet. Work on increasing traffic first.
Results
What I Gained
• Cut home page bounce rate to ~21%
• Customer testimonials was worth 5.5%
• Making image at top darker was worth 7.7%
• Choose specific theme thumbnails based on testing.
• Sales revenue up 51%
Bill Robbins
OrganizedThemes.com
@billrobbins

More Related Content

What's hot

The Breakdown of a Perfect Checkout Page
The Breakdown of a Perfect Checkout PageThe Breakdown of a Perfect Checkout Page
The Breakdown of a Perfect Checkout Page
Vivastream
 

What's hot (16)

Sli systems marcus_v2
Sli systems marcus_v2Sli systems marcus_v2
Sli systems marcus_v2
 
The Surprising Lessons Learned by Buying a Few Billion Viewable Impressions -...
The Surprising Lessons Learned by Buying a Few Billion Viewable Impressions -...The Surprising Lessons Learned by Buying a Few Billion Viewable Impressions -...
The Surprising Lessons Learned by Buying a Few Billion Viewable Impressions -...
 
The Breakdown of a Perfect Checkout Page
The Breakdown of a Perfect Checkout PageThe Breakdown of a Perfect Checkout Page
The Breakdown of a Perfect Checkout Page
 
Demystifying Website Performance and Its Impact on Revenue
Demystifying Website Performance and Its Impact on RevenueDemystifying Website Performance and Its Impact on Revenue
Demystifying Website Performance and Its Impact on Revenue
 
Understanding google analytics
Understanding google analyticsUnderstanding google analytics
Understanding google analytics
 
Migrate From Magento to Shopify With Ease
Migrate From Magento to Shopify With EaseMigrate From Magento to Shopify With Ease
Migrate From Magento to Shopify With Ease
 
Overground tech talk - tools to work smarter
Overground   tech talk - tools to work smarterOverground   tech talk - tools to work smarter
Overground tech talk - tools to work smarter
 
Londens Consulting BI Suite
Londens Consulting BI SuiteLondens Consulting BI Suite
Londens Consulting BI Suite
 
Creating Page Optimizations & Experiments in B2B
Creating Page Optimizations & Experiments in B2BCreating Page Optimizations & Experiments in B2B
Creating Page Optimizations & Experiments in B2B
 
Storefront.Be
Storefront.BeStorefront.Be
Storefront.Be
 
Get Up to Speed on Walmart's Advertising Offerings
Get Up to Speed on Walmart's Advertising OfferingsGet Up to Speed on Walmart's Advertising Offerings
Get Up to Speed on Walmart's Advertising Offerings
 
Optimizely Summer School Class 3 - Convert
Optimizely Summer School Class 3 - ConvertOptimizely Summer School Class 3 - Convert
Optimizely Summer School Class 3 - Convert
 
Retailer Case Study: Heels.com
Retailer Case Study: Heels.com Retailer Case Study: Heels.com
Retailer Case Study: Heels.com
 
WAW - WebTechAnaylytics: Turning Customer Behaviors into Business ROI
WAW - WebTechAnaylytics: Turning Customer Behaviors into Business ROIWAW - WebTechAnaylytics: Turning Customer Behaviors into Business ROI
WAW - WebTechAnaylytics: Turning Customer Behaviors into Business ROI
 
How to edit call under account in salesforce
How to edit call under account in salesforceHow to edit call under account in salesforce
How to edit call under account in salesforce
 
Under the Hood with Walmart & Amazon Advertising
Under the Hood with Walmart & Amazon AdvertisingUnder the Hood with Walmart & Amazon Advertising
Under the Hood with Walmart & Amazon Advertising
 

Viewers also liked

Stepping Into Custom Post Types
Stepping Into Custom Post TypesStepping Into Custom Post Types
Stepping Into Custom Post Types
K.Adam White
 
Custom Post Types in Depth at WordCamp Montreal
Custom Post Types in Depth at WordCamp MontrealCustom Post Types in Depth at WordCamp Montreal
Custom Post Types in Depth at WordCamp Montreal
Joey Kudish
 

Viewers also liked (9)

Stepping Into Custom Post Types
Stepping Into Custom Post TypesStepping Into Custom Post Types
Stepping Into Custom Post Types
 
WP 201 Custom Post Types - Custom Fields - WordCamp Columbus 2015
WP 201   Custom Post Types - Custom Fields - WordCamp Columbus 2015WP 201   Custom Post Types - Custom Fields - WordCamp Columbus 2015
WP 201 Custom Post Types - Custom Fields - WordCamp Columbus 2015
 
Custom Post Types--Front End
Custom Post Types--Front EndCustom Post Types--Front End
Custom Post Types--Front End
 
Advanced Custom Post Types
Advanced Custom Post TypesAdvanced Custom Post Types
Advanced Custom Post Types
 
WordPress Custom Post Types
WordPress Custom Post TypesWordPress Custom Post Types
WordPress Custom Post Types
 
Custom Post Types in Depth at WordCamp Montreal
Custom Post Types in Depth at WordCamp MontrealCustom Post Types in Depth at WordCamp Montreal
Custom Post Types in Depth at WordCamp Montreal
 
Custom Post Types and Taxonomies
Custom Post Types and TaxonomiesCustom Post Types and Taxonomies
Custom Post Types and Taxonomies
 
Custom Post Types and Taxonomies in WordPress
Custom Post Types and Taxonomies in WordPressCustom Post Types and Taxonomies in WordPress
Custom Post Types and Taxonomies in WordPress
 
Custom post types - WordPress
Custom post types - WordPressCustom post types - WordPress
Custom post types - WordPress
 

Similar to A/B Testing: Make your wildest conversion goals come true

Content Testing & Optimization (CTO) Webinar, April 29 2010
Content Testing & Optimization (CTO) Webinar, April 29 2010Content Testing & Optimization (CTO) Webinar, April 29 2010
Content Testing & Optimization (CTO) Webinar, April 29 2010
One to One
 
Gravity personalizaton intro
Gravity personalizaton introGravity personalizaton intro
Gravity personalizaton intro
Eszter Nagy
 

Similar to A/B Testing: Make your wildest conversion goals come true (20)

abtesting-Updated
abtesting-Updatedabtesting-Updated
abtesting-Updated
 
Web Analytics & Conversion Rate Optimization
Web Analytics & Conversion Rate OptimizationWeb Analytics & Conversion Rate Optimization
Web Analytics & Conversion Rate Optimization
 
Website Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure SuccessWebsite Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure Success
 
Google Analytics for Miva Merchants
Google Analytics for Miva MerchantsGoogle Analytics for Miva Merchants
Google Analytics for Miva Merchants
 
An Internet Marketing Optimization Primer
An Internet Marketing Optimization PrimerAn Internet Marketing Optimization Primer
An Internet Marketing Optimization Primer
 
A/B Testing For The Win
A/B Testing For The WinA/B Testing For The Win
A/B Testing For The Win
 
Definition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by OptimizelyDefinition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by Optimizely
 
Content Testing & Optimization (CTO) Webinar, April 29 2010
Content Testing & Optimization (CTO) Webinar, April 29 2010Content Testing & Optimization (CTO) Webinar, April 29 2010
Content Testing & Optimization (CTO) Webinar, April 29 2010
 
Understanding customer acquisition costs - a VC's view
Understanding customer acquisition costs - a VC's viewUnderstanding customer acquisition costs - a VC's view
Understanding customer acquisition costs - a VC's view
 
What’s New in Google Analytics: New Features & What You Need to Know
What’s New in Google Analytics: New Features & What You Need to KnowWhat’s New in Google Analytics: New Features & What You Need to Know
What’s New in Google Analytics: New Features & What You Need to Know
 
Introduction to Conversion Optimization - Nelio A/B Testing for WordPress
Introduction to Conversion Optimization - Nelio A/B Testing for WordPressIntroduction to Conversion Optimization - Nelio A/B Testing for WordPress
Introduction to Conversion Optimization - Nelio A/B Testing for WordPress
 
Opticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum ImpactOpticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum Impact
 
AB testing.pptx
AB testing.pptxAB testing.pptx
AB testing.pptx
 
Business to Business Ecommerce Solutions Using Miva Merchant by Dan Smith
Business to Business Ecommerce Solutions Using Miva Merchant by Dan SmithBusiness to Business Ecommerce Solutions Using Miva Merchant by Dan Smith
Business to Business Ecommerce Solutions Using Miva Merchant by Dan Smith
 
Google analytics for store owners
Google analytics for store ownersGoogle analytics for store owners
Google analytics for store owners
 
Web Analytics: A Measurement System of Website
Web Analytics: A Measurement System of WebsiteWeb Analytics: A Measurement System of Website
Web Analytics: A Measurement System of Website
 
Analytics in Action - UPCEA Central
Analytics in Action - UPCEA CentralAnalytics in Action - UPCEA Central
Analytics in Action - UPCEA Central
 
A/B Testing for WordPress & Drupal
A/B Testing for WordPress & DrupalA/B Testing for WordPress & Drupal
A/B Testing for WordPress & Drupal
 
Gravity personalizaton intro
Gravity personalizaton introGravity personalizaton intro
Gravity personalizaton intro
 
Startup Metrics 4 Pirates (Montreal, May 2010)
Startup Metrics 4 Pirates (Montreal, May 2010)Startup Metrics 4 Pirates (Montreal, May 2010)
Startup Metrics 4 Pirates (Montreal, May 2010)
 

Recently uploaded

Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
gajnagarg
 
Computer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdfComputer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdf
SayantanBiswas37
 
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
gajnagarg
 
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
gajnagarg
 
Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...
Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...
Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...
HyderabadDolls
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
ranjankumarbehera14
 

Recently uploaded (20)

Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
 
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowVadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
 
Computer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdfComputer science Sql cheat sheet.pdf.pdf
Computer science Sql cheat sheet.pdf.pdf
 
20240412-SmartCityIndex-2024-Full-Report.pdf
20240412-SmartCityIndex-2024-Full-Report.pdf20240412-SmartCityIndex-2024-Full-Report.pdf
20240412-SmartCityIndex-2024-Full-Report.pdf
 
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With OrangePredicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
 
Kings of Saudi Arabia, information about them
Kings of Saudi Arabia, information about themKings of Saudi Arabia, information about them
Kings of Saudi Arabia, information about them
 
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
 
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
 
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
 
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Latur [ 7014168258 ] Call Me For Genuine Models We ...
 
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
 
Statistics notes ,it includes mean to index numbers
Statistics notes ,it includes mean to index numbersStatistics notes ,it includes mean to index numbers
Statistics notes ,it includes mean to index numbers
 
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...
 
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt
 
Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...
Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...
Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...
 
Fun all Day Call Girls in Jaipur 9332606886 High Profile Call Girls You Ca...
Fun all Day Call Girls in Jaipur   9332606886  High Profile Call Girls You Ca...Fun all Day Call Girls in Jaipur   9332606886  High Profile Call Girls You Ca...
Fun all Day Call Girls in Jaipur 9332606886 High Profile Call Girls You Ca...
 
Dubai Call Girls Peeing O525547819 Call Girls Dubai
Dubai Call Girls Peeing O525547819 Call Girls DubaiDubai Call Girls Peeing O525547819 Call Girls Dubai
Dubai Call Girls Peeing O525547819 Call Girls Dubai
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
 

A/B Testing: Make your wildest conversion goals come true

  • 1. A/B Testing Make your wildest conversion goals come true!
  • 2. 08 Obama Campaign Test Media Test Button Text
  • 3. The Winner • Sign up rate improved from 8.26% to 11.6% — 40.6% more • 2,880,000 of the 10 million signs up from that change • 10% of sign ups become volunteers — 280K more • Each address worth $21 in donations — $60 million more
  • 4. A/B Tools • Nelio A/B Testing (http://wp-abtesting.com) • Visual Website Optimizer (https://vwo.com) • Optimizely (http://www.optimizely.com) • AB Press Optimizer plugin (http://abpressoptimizer.com) • Google Analytics — they have split testing
  • 5. Where To Test • Top landing pages • Top 5 bounce rate pages • Exit points in your conversion funnel • Most valuable pages for income
  • 6. First 10 Tests • 4 Message tests — Headings • 2 Large design changes • 4 Aha moments — look for points where your expecting your customer to understand your product.
  • 8. Results • You need at least 100 visitors per variation and 25 conversions per variation. More are better. • The longer a test runs, the more accurate the results will be. • If you have a low traffic site, this isn’t a tool for you just yet. Work on increasing traffic first.
  • 10. What I Gained • Cut home page bounce rate to ~21% • Customer testimonials was worth 5.5% • Making image at top darker was worth 7.7% • Choose specific theme thumbnails based on testing. • Sales revenue up 51%