Featuring speakers from Optimizely Khattaab Khan, Strategic Consultant, Optimizely If your idea of results analysis is peaking at your results page in hopeful search for green boxes, check out this session for a discussion about how to leverage Annotations, Custom Views, and the Difference Interval calculation to more effectively document your findings foster an agile and iterative testing program.

1. Reading Between the
Lines: Get the Most Out
of Your Results Page
#opticon2015
Khattaab Khan
Strategy Consultant, Optimizely
@khattaabkhan
khattaab@optimizely.com

2. Undergraduate-Level
Results Analysis

3. Undergraduate-Level Results Analysis
Performance Summary Audience Segmentation
Statistics

4. Undergraduate-Level Results Analysis
Performance
Summary
1. How many unique visitors ran through
my experiment?
2. How long did it run?
3. Did any variations achieve statistically
significant conversion lift?
Questions you should be able to
answer in a glance

5. Undergraduate-Level Results Analysis
Audience
Segmentation
1. Did any segments show conversion
trends drastically different than the
total sample?
2. Are my custom segments capturing a
meaningful volume of traffic?
Questions you should be able to
answer in a glance

6. Undergraduate-Level Results Analysis Statistics
1. What is the value of 2-tailed analysis
2. Does the demonstrated lift
improvement exceed my pre-
determined MDE (Opportunity Costs)
3. What is the Difference Interval range?
Questions you should be able to
answer in a glance

7. What Sets Apart
Basic Results Analysis from
Advanced?

8. Organization

10. Organize Test Plans + Results
to Maximize Reach of Testing
Program

11. Roadmap Summarizes Test Plan + Results
Detailed Assessment

12. Roadmap Visualization
Roadmunk Software

13. Shared Variation Design Archive

14. Shared Variation Design Archive

15. Shared Variation Design Archive

16. Let’s Get More Organized
within Optimizely

17. #ExperimentLabels

18. #ExperimentLabels

19. #ExperimentLabels

20. Extract More Value Out of
Optimizely Event Tracking

21. Alternate Metric Axes

23. Alternate Metrics

24. Consider Correlation
Between Traffic Waves
and Variation Performance

25. Traffic Volume

26. Chart Annotation

27. Provide Visibility into
External Influences

28. Chart Annotation

29. Organize data to effectively communicate
results; implement analytics integrations
Takeaways
Leverage advanced results page features to
distill metrics that matter to your
organization
Maximize reach of results sharing

30. #opticon2015
Q&A
Khattaab Khan
Strategy Consultant, Optimizely
@khattaabkhan
khattaab@optimizely.com