A/B testing is great. But if you just go around testing every idea that pops into your head, you could be in for a lot of testing. And ultimately, bitter disappointment. I’ll show how to come up with ab-tests that will really make a difference by doing user research (analytics, targeted surveys, user session recording, user testing, …).

1. How to create better A/B tests
based on user research
Karl Gilis
@agconsult

2. Some of our clients

3. Part I
A/B testing: the basics

6. Part II
Main problems with A/B testing

7. Don't test stupid things

8. Don't test every idea that pops into your head

9. Make sure you measure the right goals

10. Don't copy tests you've seen on other websites

11. Know why you're running an A/B test

12. Make sure you've got a solid hypothesis
This example is from Michael Aagaard (@contentverve)

13. Part III
How user research can help you to
create more successful A/B tests

14. Which methods can you use?
• Google Analytics
• User testing (Morae)
• Eyetracking (MyGaze eyetracker, Tobii)
• User sessions recording (Mouseflow, Inspectlet, Hotjar)
• Mouse heatmaps (Hotjar, CrazyEgg)
• Form analysis (Formisimo)
• Targeted mini surveys (Qualaroo, Hotjar,…)

15. User testing with eyetracking

18. + 45,9% clicks on "Get a quote"
+ 15,6% clicks on "Book a test drive"

19. Put your calls-to-action where
people see them.
I know this doesn't sound very innovative. But it’s really important.

20. User session recording & mouse heatmaps

22. 43,8% more clicks
Why does this always work?
A user who scrolls to the end of your
page is probably pretty interested in
what you have to offer.
You just have to reel him in at the end.

23. Repeat your CTA at the bottom of
your page.
Believe me. This works. Always.

24. I'm sorry, but this client doesn't allow me to show the real page and
his brand name. So I made a mock-up.

25. • 27,2% more clicks on
the red contact buttons.
• 46,0% more clicks on
the blue button.
12,2% more clicks on these boxes
6,6% more clicks below the page fold.

26. Be careful with big headers & big,
useless photos.
Focus on your message. That will result in more conversions.

27. Only 1 out 2 visitors started to scroll.
So we made some changes to the first screen. (We're not
allowed to show this in detail. Sorry.)
Those changes have to do with copy. Not so much with
design.

28. 32,5% more people reach this point:
- Our version: 69,45%
- Original: 52,41%
44,1% more people reach this point
100% more visitors go to a product detail page
76,2% more requests for quote
57,8% more brochure downloads
These are the results of those changes…

29. Use tools to find where the problem
areas are.
And use your brain or user input to make them better.

30. Form analysis (& user session recording)

31. Formisimo revealed which fields caused most
problems

32. 52,9% more requests for offer.

33. Make forms as easy as possible.
And use tools to reveal where the real problems are. Don't guess.

34. 35,4% more forms submitted

35. Explain why you want certain
information.
Make sure you use positive words. You don't want to frighten the visitor.

36. Targeted surveys

37. What is the purpose of your visit to our website today?

38. + 188% more clicks
+ 75% more sales from homepage visitors

39. Push product categories instead of
individual products.
This depends from site to site. But most of the time it works. Big time.
.

40. What is the purpose of your visit to our website today?

41. 23 times more people use the dealer locator

42. Integrate first steps of interactions
in your pages.
Ton from @OnlineDialogue calls this the 'foot-between-the-door-trick'
.

43. What’s important for you when choosing a new car?
Besides the way it looks.

45. - 7,5% extra clicks to model pages
- Even a bigger increase in number
of requests for offer

46. Make it easy to choose/compare.
Make sure you use the main decision criteria and emotional triggers of
your users
.

47. What are the most important things when buying a
used car?

48. 26% more reservations

49. Place what's important for your
visitors on the left side of your page.
This can sometimes make a difference. Sometimes it doesn't do sh*t.
.

50. What convinced you the most to decide to ask a
quote?
Was there something that made you hesitate?
If so, what?
77,1% more requests for quote

51. Know what your clients & visitors
want.
And get filthy rich 
.

52. Free bonus tip

53. Get my free ebook now
 10 conversion tips that work on every website
 15 cases from the real world
 6 best practices from leading websites
 www.agconsult.com/ebook.html
 www.slideshare.net/agconsult
Already more than 2.357 downloads

54. That's it!
Thx