Combining analytics and user research
•Descargar como PPTX, PDF•
4 recomendaciones•903 vistas
Presentation about combining analytics and user research, talk at UX Brighton event, 13 July 2010.
Recomendados
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Similar a Combining analytics and user research
Similar a Combining analytics and user research (20)
Último
Último (20)
Combining analytics and user research
- 1. Combining Analytics and User Research Alex Tarling User Experience Consultant
- 2. About the session: Why is it good to combine methodologies? Why doesn’t this commonly happen already? Some opportunities to combine analytics and user research… … some case studies and some hints and tips to get started!
- 3. Who am I? Freelance user experience consultant 12 years experience of design research, UX, information architecture Projects for Intel, BBC, Nokia, Orange, New Look, Blacks, Millets etc http://linkedin.com/in/alextarling
- 4. User Experience Research “User experience research is a collection of tools designed to help you find the boundaries of peoples needs and abilities“- Mike Kuniavsky
- 5. User Experience Research “User experience research is a collection of tools designed to help you find the boundaries of peoples needs and abilities“- Mike Kuniavsky ”The field of user experience, is blessed (or cursed) with a very wide range of research methods“- Christian Rohrer
- 6. Web Analytics "Web Analytics is the measurement, collection, analysis and reporting of Internet data for the purposes of understanding and optimizing Web usage.“- The Official WAA Definition of Web Analytics
- 7. Why use a combination of methods? ”When all you have is a hammer, everything looks like a nail”- Abraham Maslow
- 8. Why use a combination of methods? All methods have strengths and weaknesses Combining methods with different attributes allows us to: Triangulate between the strengths of individual methods Mitigate the weaknesses and risks of each
- 9. Why are user research and analytics methods not routinely combined? Because user research and analytics are often commissioned and actioned by very different functions in the organisation. Because user research and analytics often happen at different stages in the product cycle. Analytics developed in a context to measure against business-goals, whereas user research is deployed as an aspect of the customer experience.
- 10. Attributes of different methods: Observational User Research Primarily qualitative: provides insights about users’ goals, motivations and attitudes We can explore context and opportunities, and what doesn’t happen as well as what does happen But, small sample sizes and high cost means we end up with a snapshot in time, and specific demographics. Lab settings can also be problematic So, observational findings open to challenge / multiple interpretation Web Analytics Quantitative and based in real-world data – talks about what is happening. Large sample sizes mean high degrees of confidence But, interpretation of behavioural aspects is hard without additional customer insight Where we predefine measures, prior assumptions about meaning and significance can become entrenched
- 11. Design of Terminal 5 - Risks of insight research…
- 12. Quantitative methods also have down sides... ”Not everything that can be counted counts; and not everything that counts can be counted ”- Albert Einstein
- 13. We have ‘abandonment’ issues… www.shopsafe.co.uk/news/online-shopping-cart-abandonment-analysed-by-royal-mail/10098
- 14. We have ‘abandonment’ issues… www.shopsafe.co.uk/news/online-shopping-cart-abandonment-analysed-by-royal-mail/10098 … assumptions about the implications of ‘abandonment’ don’t talk to real-world customer experience…
- 15. We have ‘abandonment’ issues… (econsultancy.com/blog)
- 16. We have ‘abandonment’ issues… = Still missing the opportunity to genuinely explore and design for customer experience!
- 17. Opportunity 1: Use customer insight data to inform analytics measures So that analytics reporting genuinely reflects and supports the customer experience, not just the business goals
- 18. Opportunity 1: use customer insight data to inform analytics measures Deliver actionable analytics metrics from your customer research insights (because user research and analytics often happen at different stages in the product cycle) Broker communication and collaboration across informational silos, and between phases in the product lifecycle (because user research and analytics are often commissioned and actioned by very different depts.) How to get started:
- 19. Opportunity 2: Use analytics data to drive the user research programme
- 20. E-commerce redesign project: Driving the user research programme from analytics data
- 21. Opportunity 2: use analytics data to drive the user research programme Just do it! You can do a lot with even basic levels of analysis Think laterally about the sources of data that are available Commission specific analysis of existing data sources How to get started:
- 22. Opportunity 3: Integrate analytics and user research to optimise the user experience throughout the product lifecycle
- 23. The Open University support for new distance learners:
- 24. Opportunity 3: Integrate analytics and user research to optimise user experience throughout the product lifecycle Ongoing use of analytics to discover and target behaviors or interactions for the research programme to ‘evidence’ user research insights Rapid iterations of ‘fast’ user research interventions Targeted against specific analytics findings to generate insights and use-cases for development Integration means adapting the product lifecycle to support continual innovation ‘Launch early and listen’ and agile strategies How to get started:
- 25. In summary Opportunity 1: use customer insight data to inform analytics measures Opportunity 2: use analytics data to drive the user research programme Opportunity 3: integrate analytics and user research to optimise user experience throughout the product lifecycle Thanks! Alex.Tarling@gmail.com
Notas del editor
- The focus on optimisation sets an interesting constraint on the use of web analytics – you can optimise a process to improve efficiency, or reduce errors. But the implication here is that web analytics doesn’t have much to offer the design process, and I think there are significant opportunities.
- We are shaped by the tools we use habitually. Its good for us as practioners in a range of disciplines to be able to draw on different disciplines. And with the current generation of tools like google analytics means you don’t have to be a specialist to get depth and value.
- London Heathrow Airport Terminal 5 forecast that future travellers would be older. Research into older travellers showed they often go into the toilet, so many new toilets were planned. !However, deeper investigation discovered they were going into the toilets….to hear the announcements. It was the only place they could find where they could clearly hear the flight calls! So now the airport is putting new audio areas where you can clearly hear your flight call…. (credit Clive Grinyer)
- Shopping cart abandonment can be easily measured. Shopping cart abandonment is a useful metric from a business perspective – it measures sales not made today. But problems arise when it is used to describe the customer experience – and when conclusions like this one are drawn So abandonment as it is framed here is a technical concept that originates from the mental model that the business has of its process. It doesn’t effectively describe the customer experience, and actually it can serious constrain thinking from a customer-centric perspective.http://www.shopsafe.co.uk/news/online-shopping-cart-abandonment-analysed-by-royal-mail/10098
- http://econsultancy.com/blog/6075-checkout-abandonment-on-the-riseSo of course it easy to see that customer behaviors are significantly more complex than the headlines suggest – as per this recent research from Forrester. So 3 out of 5 of these reasons don’t represent abandonment at all – they represent real opportunites to create an ongoing relationship with the customer.
- The fact that we continue to use these business-objective metrics to characterise customer behaviour is potentially a real missed opportunity.
- Case study for previous iteration of the design: conversion rates had declined over the lifetime of the site – around a 2-year process. The sense was that the shopping basket and checkout were increasingly outdated and this was preventing completion of sales. A project was defined to re-design the checkout and basket and comparative usability study commissioned. Closer exploration of the available analytics didn’t really support the theory that the checkout was the problem area and the user study was widened. It actually turned out that the merchandising strategy for the site had also degraded over the lifecycle – customers just weren’t being presented effectively with product, and the checkout process was not the main issue.
- May require additional relationships within the clients
- A very challenging target audience of ‘at risk’ learners – older, generally low levels of previous education, generally lack confidence with computers, very often have other issues that are a barrier to engaging with education. A ‘launch early and listen’ strategy. An initial exploration of the analytics helped us define the targets for the research for this iteration, and helped define the demographics – so a very targeted cost-effective piece of user research. One of the main target areas was around use of video on the site. Less than 10% of visitors use the video – so significant pressure to reduce its use on the site. But those that did often watched several video segments. From the user research we identified specific customer segment – the core of our most vulnerable users that were motivated and engaged by video. And a model for what they got from the video and how they were likely to use that defined how to use video in the future.
- Analytics isn’t enough – does not generate formative insights on its ownQualitative, observational user research generates formative insights, but is too expensive to do continually