Lisa Seaman, User Experience Manager at Autodesk, shares how she tests and optimizes Autodesk’s websites with UserTesting. She’ll discuss how her team uses UserTesting and why it has become such a crucial tool for their agile approach.

1. How Autodesk creates better digital
experiences with UserTesting
#UTwebinar @UserTesting
Lisa Seaman
User Experience Manager, Autodesk

2. UserTesting’s on demand customer
insights platform enables companies
to create powerful products and
exceptional customer experiences.
#UTwebinar

3. We Partner With Thousands Of Customers
#UTwebinar

4. Across All Platforms, At All Stages Of Development
Watch customers interact with:
DESKTOP SMARTPHONE TABLET
WEBSITES APPS &
PROGRAMS
PROTOTYPES &
WIREFRAMES
SURVEYS PHYSICAL
PRODUCTS
Anywhere people interact with your brand:
AT HOME AT A STORE ON THE GO
On any pla6orm or device:
#UTwebinar

5. 8
Lisa Seaman
User Experience Manager, Autodesk
Lisa Seaman, User Experience Manager at Autodesk, is a customer advocate at heart.
She uses A/B testing, usability studies, web analytics, and customer comments to
evaluate websites and find opportunities to make them work better. She has worked
in the user experience and web analytics space for over 12 years and her past
stomping grounds include WhichTestWon, Sun Microsystems, and Outward Bound.
@BoulderLisaS
#UTwebinar

6. © 2016 Autodesk© 2016 Autodesk© 2016 Autodesk
Lisa Seaman
User Experience Manager
@BoulderLisaS
UserTesting Webinar, February 2017
How Autodesk creates better digital
experiences with UserTesting

9. @BoulderLisaS #UTwebinar

10. 1. We meant well
2. Sometimes you want to convince
3. Comparison studies
4. A/B testing pairs well with UserTesting
5. + 4 tips!
Case Studies
@BoulderLisaS #UTwebinar

11. We meant well…

13. Pricing

15. Pricing

16. We meant well, but through
UserTesting we learned that
it’s still confusing
@BoulderLisaS

17. I am in a SPRINT
and don’t have
enough time
Tip #1: Use more
ratings, written, and
multiple choice
questions
@BoulderLisaS

18. Sometimes you want to learn,
and sometimes you want to
convince
@BoulderLisaS

20. UserTesting video clips can
help make a convincing case
for change
@BoulderLisaS

21. What
should I
test?
Tip #2: Read customer
comments or talk to tech
support. Run tests on tasks
that customers tell you
about or that you are
concerned about.
@BoulderLisaS

22. For comparison studies,
consider swapping the
order of tasks
@BoulderLisaS

26. Quotes – What is this a picture of?
“canal”
Image A
“channel”
“sea port”
“dam concept”
“a series of water locks”
Image B
“water reservoir”
“a park”
“urban design, lighting poles,
streets, houses, empty plots, a
reservoir”

27. Quotes – Which image do you like better?
“Image A lends more
focus to the concept.”
“It is better to infer from
Image A what is
represented by it.”
“Looks much more
realistic.”
“It’s more complex,
has more details.”
Image A Image B

28. Which image did people prefer?
23%
77%
Like A better Like B better
Users who saw A first, then B
§ Image B was easier to understand after seeing image A
50% 50%
Like A better Like B better
Users who saw B first, then A

29. Swapping the
order of tasks
allows you to
learn more and
not be misled

30. For comparison studies,
swap the order of tasks to
learn more
@BoulderLisaS

31. For a comparison study
where half the people see
A then B, and the other
half see B then A, can I do
that in one test?
Tip #3: Use two
separate tests to do a
comparison study.
@BoulderLisaS

32. If you do a/b testing, add a
UserTesting study
@BoulderLisaS

33. Experiences for AutoCAD LT
Exp A radio button
Exp B vertical stack
Exp C horizontal boxes

36. A UserTesting study pairs
well with an A/B test; add
qual to your quant
@BoulderLisaS

37. Too many
participants are
young….
Tip #4: Use two groups to
get an even split of ages
or browsers or genders
within one test.
@BoulderLisaS

38. Case Studies
1. Evaluate usability (We meant well…)
2. Make a convincing case for change
3. Comparison study
4. A/B testing pairs well with UserTesting
Summary
@BoulderLisaS
Tips
1. In a hurry? Use more ratings, written, and multiple choice questions.
2. Looking for test ideas? Read customer comments or talk to tech support.
3. For a comparison study, swap the order of tasks and use two separate tests.
4. Want more older participants? Use two groups to get an even split of ages (or
browsers or genders) within one test.

39. Thanks!
Q&A?@BoulderLisaS

40. © 2016 Autodesk. All rights reserved.
Autodesk and the Autodesk logo are registered trademarks or trademarks of Autodesk, Inc., and/or its subsidiaries and/or affiliates in the USA and/or other countries. All other
brand names, product names, or trademarks belong to their respective holders. Autodesk reserves the right to alter product and services offerings, and specifications and pricing at
any time without notice, and is not responsible for typographical or graphical errors that may appear in this document.