7. Signup, upgrade, onboarding
• Invest in a great experience
• Test with usertesting.com
• Track the funnel:
• Number of trials
• Leads to Trials to Paid by weekly cohort
• Onboarding success
Wednesday, 6 November 13
8. Product UX Testing
Numbers don’t tell you how to improve.
Workshops
(personas)
Concepting
(sketches)
Prototypes
Qualitative
(Axure)
You can use an iPad at a Cafe and show keynote.
Key point is to test mockups on people first.
Wednesday, 6 November 13
Quantitative
(Loop11)
10. Measure Product Success
•
Customer success
•
•
•
•
•
Wednesday, 6 November 13
Time to first sale
Time to launch
Trend monthly or weekly cohorts
Engagement score during trial
Churn and conversion predictive models
11. Feature KPI
•
Before you build a
feature, define a success
KPI
•
•
Wednesday, 6 November 13
e.g. Number of
product reviews
completed
e.g. 30% fewer
abandoned carts
•
e.g. completing task
more quickly
•
Add instrumentation
before and after
•
Deploy to subset of
customers to test
•
Consider Mixpanel
12. Split Test Important Things
• Persona analysis and customer interviews
on new brand
• Route traffic p new, 1-p old (control)
• Measure effect on conversion with 95%
confidence interval of a difference and
ZScore
Wednesday, 6 November 13
13. A/B Testing Report and significance
p +/- (1.65 x SE)
https://developer.amazon.com/sdk/ab-testing/reference/ab-math.html
Wednesday, 6 November 13
15. Power law
Think 80/20 rule.
Store revenue, traffic, disk usage, number products, etc.
http://www.hpl.hp.com/research/idl/papers/ranking/ranking.html
Wednesday, 6 November 13
16. Continuous Delivery
• Feature flag everything and gently deploy
• Deploy daily — huge difference!
• Read 12factor.net (dev, staging, production)
• Monitor (i.e. NewRelic)
• Practice BDD & continuous integration
• Always have a recovery plan
Wednesday, 6 November 13
20. Startup Friendly Stack
•
Use Ruby Sinatra (or Clojure) +
CoffeeScript + Backbone +
Handlebars on Heroku
•
Nesta for CMS and learn textmate,
Haml & Sass, see https://github.com/
sharner/Workshop-Site
•
HTML5 mobile first, responsive
design
•
Use Mailchimp, Wufoo,
SurveyMonkey
•
R for data (http://r-project.org) —
treat as code, put in Github
•
Log events to understand customer
success (see Heroku Plugins)
Wednesday, 6 November 13
21. Peopleware
•
Do learn to code simple website
changes and growth hacking
•
Learn some stats
•
Do find a technical co-founder
•
Don’t offshore
•
Don’t churn people
•
Do find designer who codes
frontend and does user testing
Wednesday, 6 November 13