SlideShare una empresa de Scribd logo
1 de 23
Shopzilla Site Redesign – We get what we measure
Phil Dixon, VP Engineering
Velocity 2009




                                                   June 23rd, 2009   |   Velocity 2009
2




          Shopzilla, Inc. - Online Shopping Network




    100M                                                        8,000+
impressions/day                                           searches per second




   20-29M                                                            100M+
UV’s per Month                                                      Products




                                           Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
3



Background
  •   In 2000, the business was simple - bizrate.com in the US
  •   Co-brands, API and shopzilla.com
  •   Multivariate testing, Europe and multiple data centers


  •   Always in a rush


  •   Difficult to change, differentiate
  •   Site had become slow  between 4-6 second page loads




                                           Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
4



Our Build Approach
   •   Start over, stay simple
   •   Build 2 weeks at a time, deliver every page ASAP
   •   Manage risk by managing exposure




                                          Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
5



Shopzilla Site Technology Overview




                             Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
6



Anatomy of a Page Request




                            Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
7



digitalcameras.bizrate.com – Server Side
                                 0   25   50   75   100    125     150      175      200     225      250
               Sessionization
                   Taxonomy
                     Keyword
                   Taxonomy
                SEO Content
              Product Search
                   Attribution
                User Content
             Category Search
             Sponsored Links
                Search Log 1
             Product Reviews
                User Content
                SEO Content
                Search Log 2
                SEO Content
                   Taxonomy
            Related Searches
              Product Details
            Related Searches
                      Banner
                      Banner
                   Attribution
                      Banner
                      Banner
                      Banner
                      Banner
                      Banner
                Access Log 1
                Access Log 2




                                                     Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
8



SLA’s – Key to High Performance

•   650ms server side
•   1.5s user experience
•   At the 95th percentile
•   Under peak loads
•   0% error rate




                             Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
9



Most Performance Gains in the Browser




     Images toResponse Time
          Server non-cookie domain resulted in


        0.5% oftop line revenue increase!
           Rest the Page                                    Banners, 19%


                              Other, 51%
                                                                 Images, 30%




                                           Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
10



Can you spot our release dates?


                                            shopzilla.com
                                            10/13/08




     bizrate.com
     10/17/08




                              Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
11



Gratuitous Graph Slide




                         Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
12




Yeah, yeah… but did we make money?




                    Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
13




Site conversion rates increased 7-12%

 Revenue = sessions x conversion % x CPC




                         Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
14



Performance Impacts Abandonment
            Sessions to Google Clicks Ratio
  100.00%

   98.00%

   96.00%

   94.00%

   92.00%

   90.00%                                                          Bizrate
                                                                   Shopzilla
   88.00%

   86.00%

   84.00%




                                    Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
15



Performance Penalties & bizrate.co.uk




                                   ~120% SEM
                                    Sessions




                              Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
16



Performance Summary
  •   Conversion Rate                +7% - 12%
  •   Page View’s                    +25%
  •   US SEM Sessions                +8%
  •   Bizrate.co.uk SEM Sessions     +120%


  •   Infrastructure Required (US)   -50% (200 vs 402 nodes)
  •   Availability                   99.71%  99.94%
  •   Product Velocity               +225%
  •   Release Cost                   $1,000’s  $80




                                           Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
17




Is Performance Worth The Expense?

             YES!




                    Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
18




Key Decision: Refactor or Rebuild




                    Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
19




Simplicity, Speed and Quality
   are design decisions




                  Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
20




Performance Gain Can Be Unexpected




                    Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
21




We Get What We Measure




              Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
22




Lots More To Come




            Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
Thank You!

Blog:    tech.shopzilla.com
Email:   velocity@shopzilla.com
Jobs:    jobs.shopzilla.com




                                  Phil Dixon – VP, Engineering   | Velocity 2009 | June 23 rd, 2009
                                                         June 23rd, 2009    |   Velocity 2009

Más contenido relacionado

Similar a Shopzilla's "You Get What You Measure" - Velocity 2009

Abb presentation uklug
Abb presentation uklugAbb presentation uklug
Abb presentation uklug
dominion
 
CHI 2009 Highlights
CHI 2009 HighlightsCHI 2009 Highlights
CHI 2009 Highlights
frog
 
Managing softwaredebt agilepalooza-redmond-sept2010
Managing softwaredebt agilepalooza-redmond-sept2010Managing softwaredebt agilepalooza-redmond-sept2010
Managing softwaredebt agilepalooza-redmond-sept2010
Chris Sterling
 
BIM Roundtable Webinar 1/15/09
BIM Roundtable Webinar 1/15/09BIM Roundtable Webinar 1/15/09
BIM Roundtable Webinar 1/15/09
kpreddy
 
Euma spain managing remote teams victor duart
Euma spain managing remote teams victor duartEuma spain managing remote teams victor duart
Euma spain managing remote teams victor duart
Pilar de Torres Gimeno
 
Striking Gold! How Mobile Marketing Pioneers are Winning the Hearts & Minds o...
Striking Gold! How Mobile Marketing Pioneers are Winning the Hearts & Minds o...Striking Gold! How Mobile Marketing Pioneers are Winning the Hearts & Minds o...
Striking Gold! How Mobile Marketing Pioneers are Winning the Hearts & Minds o...
affilinet
 

Similar a Shopzilla's "You Get What You Measure" - Velocity 2009 (20)

Dev Days 2009 - iPhone Development Overview
Dev Days 2009 - iPhone Development OverviewDev Days 2009 - iPhone Development Overview
Dev Days 2009 - iPhone Development Overview
 
Why Web Projects Fail
Why Web Projects FailWhy Web Projects Fail
Why Web Projects Fail
 
J Foster Caddfx AEC Presentation
J Foster Caddfx AEC PresentationJ Foster Caddfx AEC Presentation
J Foster Caddfx AEC Presentation
 
Abb presentation uklug
Abb presentation uklugAbb presentation uklug
Abb presentation uklug
 
How BIM Can Accelerate Project-Wide Review Cycles - Webinar, November 11, 2015
How BIM Can Accelerate Project-Wide Review Cycles - Webinar, November 11, 2015How BIM Can Accelerate Project-Wide Review Cycles - Webinar, November 11, 2015
How BIM Can Accelerate Project-Wide Review Cycles - Webinar, November 11, 2015
 
CHI 2009 Highlights
CHI 2009 HighlightsCHI 2009 Highlights
CHI 2009 Highlights
 
Managing softwaredebt agilepalooza-redmond-sept2010
Managing softwaredebt agilepalooza-redmond-sept2010Managing softwaredebt agilepalooza-redmond-sept2010
Managing softwaredebt agilepalooza-redmond-sept2010
 
Making Facebook Faster
Making Facebook FasterMaking Facebook Faster
Making Facebook Faster
 
IBM Dynamic Infrastructure - A Telecom Case study
IBM Dynamic Infrastructure - A Telecom Case studyIBM Dynamic Infrastructure - A Telecom Case study
IBM Dynamic Infrastructure - A Telecom Case study
 
Fabio Sergio: Design Thinking for the Future
Fabio Sergio: Design Thinking for the FutureFabio Sergio: Design Thinking for the Future
Fabio Sergio: Design Thinking for the Future
 
Cr and-vm-reduced
Cr and-vm-reducedCr and-vm-reduced
Cr and-vm-reduced
 
Sunz2012 2011-2012 bi trends
Sunz2012   2011-2012 bi trendsSunz2012   2011-2012 bi trends
Sunz2012 2011-2012 bi trends
 
BIM Roundtable Webinar 1/15/09
BIM Roundtable Webinar 1/15/09BIM Roundtable Webinar 1/15/09
BIM Roundtable Webinar 1/15/09
 
Safety implementation in BIM
Safety implementation in BIMSafety implementation in BIM
Safety implementation in BIM
 
Collaborating in the Cloud with Lync
Collaborating in the Cloud with LyncCollaborating in the Cloud with Lync
Collaborating in the Cloud with Lync
 
Leveraging BIM throughout the construction process
Leveraging BIM throughout the construction processLeveraging BIM throughout the construction process
Leveraging BIM throughout the construction process
 
Euma spain managing remote teams victor duart
Euma spain managing remote teams victor duartEuma spain managing remote teams victor duart
Euma spain managing remote teams victor duart
 
Modularization
ModularizationModularization
Modularization
 
Agile Bill.Lean Primer.0906a
Agile Bill.Lean Primer.0906aAgile Bill.Lean Primer.0906a
Agile Bill.Lean Primer.0906a
 
Striking Gold! How Mobile Marketing Pioneers are Winning the Hearts & Minds o...
Striking Gold! How Mobile Marketing Pioneers are Winning the Hearts & Minds o...Striking Gold! How Mobile Marketing Pioneers are Winning the Hearts & Minds o...
Striking Gold! How Mobile Marketing Pioneers are Winning the Hearts & Minds o...
 

Último

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Último (20)

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 

Shopzilla's "You Get What You Measure" - Velocity 2009

  • 1. Shopzilla Site Redesign – We get what we measure Phil Dixon, VP Engineering Velocity 2009 June 23rd, 2009 | Velocity 2009
  • 2. 2 Shopzilla, Inc. - Online Shopping Network 100M 8,000+ impressions/day searches per second 20-29M 100M+ UV’s per Month Products Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 3. 3 Background • In 2000, the business was simple - bizrate.com in the US • Co-brands, API and shopzilla.com • Multivariate testing, Europe and multiple data centers • Always in a rush • Difficult to change, differentiate • Site had become slow  between 4-6 second page loads Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 4. 4 Our Build Approach • Start over, stay simple • Build 2 weeks at a time, deliver every page ASAP • Manage risk by managing exposure Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 5. 5 Shopzilla Site Technology Overview Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 6. 6 Anatomy of a Page Request Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 7. 7 digitalcameras.bizrate.com – Server Side 0 25 50 75 100 125 150 175 200 225 250 Sessionization Taxonomy Keyword Taxonomy SEO Content Product Search Attribution User Content Category Search Sponsored Links Search Log 1 Product Reviews User Content SEO Content Search Log 2 SEO Content Taxonomy Related Searches Product Details Related Searches Banner Banner Attribution Banner Banner Banner Banner Banner Access Log 1 Access Log 2 Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 8. 8 SLA’s – Key to High Performance • 650ms server side • 1.5s user experience • At the 95th percentile • Under peak loads • 0% error rate Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 9. 9 Most Performance Gains in the Browser Images toResponse Time Server non-cookie domain resulted in 0.5% oftop line revenue increase! Rest the Page Banners, 19% Other, 51% Images, 30% Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 10. 10 Can you spot our release dates? shopzilla.com 10/13/08 bizrate.com 10/17/08 Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 11. 11 Gratuitous Graph Slide Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 12. 12 Yeah, yeah… but did we make money? Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 13. 13 Site conversion rates increased 7-12% Revenue = sessions x conversion % x CPC Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 14. 14 Performance Impacts Abandonment Sessions to Google Clicks Ratio 100.00% 98.00% 96.00% 94.00% 92.00% 90.00% Bizrate Shopzilla 88.00% 86.00% 84.00% Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 15. 15 Performance Penalties & bizrate.co.uk ~120% SEM Sessions Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 16. 16 Performance Summary • Conversion Rate +7% - 12% • Page View’s +25% • US SEM Sessions +8% • Bizrate.co.uk SEM Sessions +120% • Infrastructure Required (US) -50% (200 vs 402 nodes) • Availability 99.71%  99.94% • Product Velocity +225% • Release Cost $1,000’s  $80 Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 17. 17 Is Performance Worth The Expense? YES! Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 18. 18 Key Decision: Refactor or Rebuild Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 19. 19 Simplicity, Speed and Quality are design decisions Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 20. 20 Performance Gain Can Be Unexpected Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 21. 21 We Get What We Measure Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 22. 22 Lots More To Come Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009
  • 23. Thank You! Blog: tech.shopzilla.com Email: velocity@shopzilla.com Jobs: jobs.shopzilla.com Phil Dixon – VP, Engineering | Velocity 2009 | June 23 rd, 2009 June 23rd, 2009 | Velocity 2009