Redesigning a web site without data and testing is like cooking in the dark. Someone is probably going to end up burned, and it's likely to be you.
How do you keep the CEO from designing the site him or herself? How do you hold back the committee of people who want home page real estate for their pet projects? And if the answer is through analytics, how do you make good aesthetic decisions while paying attention to data?
Kate O'Neill addresses these questions, speaking from her experience managing data-driven incremental redesigns of sites like Netflix, Magazines.com, and many others. She is Founder and CEO of [meta]marketer, an optimization-focused marketing agency that helps clients maximize the value in their online presence.
(Presented at BarCamp Nashville 2009, also known as bcn09 or #bcn09.)
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Evolution Not Revolution: Why Optimizing Beats Redesigning
1. Evolution,
not Revolution.
Why Optimizing
Beats Redesigning.
[presented by] Kate O’Neill
of [meta]marketer
Image credit: funfonix.com
2. Who am I to make
these claims?
And who are you
to listen?
3. Why I’m a Believer
• Helped lead rollout through data awareness of
interactive redesign at Netflix that is still standard
for e-commerce
• Oversaw many multivariate tests at Magazines.com
that resulted in 40% lift in conversion rate YOY
• Now own a company that focuses on this kind of
optimization for clients with great results
4. Why You May
Choose to Believe
• Working in a company torn by politics or
conflicting interests in web design or feature?
• Designing sites freelance and always encountering
the same resistance?
• Running personal web sites and blogs you’d like to
see perform better?
14. Data trumps
opinions.
Even highly paid
ones.
HPPO
Use conversion-related metrics
to determine executive-relevant
strengths and weaknesses of the site.
15. If it isn’t
interesting
to the user, ditch
it.
Committee
Use engagement metrics
to determine what keeps users on the site.
16. Think users like
your design?
Prove it.
Design for
Design’s Sake
If your success can’t be measured,
you can’t defend it.
And your input won’t be appreciated.
17. “Great idea! I’ll
add it to the
testing roadmap.”
Finger in
the Wind
Trendy ideas are worth knowing about.
But they may not work in your environment.
21. What to do?
‣ Balance subjective & objective testing
(And know that you may get it wrong)
‣ Find the story behind the story
(But know that you may get it wrong)
‣ Look for a narrative in onsite testing
(But know that you may get it wrong)
‣ Look for the unobvious AND the obvious
(And know that you may get it wrong)
22. If you’re still going to
get it wrong, why test?
Because you can not only measure lift
when you’re right...
(Woo hoo!)
you can also contain risk when you’re
wrong.
(And it just might save your job.)
29. Look Inside: Results
• Visitors more likely to click on Preview offer (4.89% average) vs. Explore
(3.85%)
• Both variations resulted in a drop in conversion
• Drop in conversion only slightly greater with Preview (-.87%) than with
Explore (-.76%)
• Overall, more established titles (Time, Sports Illustrated, People) had
lowest Click % as well as below average drop in conversion of all viewer-
enabled titles
• Somewhat lesser-known titles (SI Kids, Health, StyleWatch, Money) had
highest Click % and higher than average drop in conversion of all viewer-
enabled titles
30. What to do?
(Once more with feeling!)
‣ Balance subjective & objective testing
(And know that you may get it wrong)
‣ Find the story behind the story
(But know that you may get it wrong)
‣ Look for a narrative in onsite testing
(But know that you may get it wrong)
‣ Look for the unobvious AND the obvious
(And know that you may get it wrong)
31. If all else fails:
[meta]marketer can help.
Thank you!
Kate O’Neill, Founder / CEO
kate@metamarketer.com
615-852-META
twitter: @kateo / @metamarketer