SlideShare una empresa de Scribd logo
1 de 50
Descargar para leer sin conexión
Jim Ross
Design Philadelphia: The Bleeding Edge of Design Research

October 16, 2013
Covert Naturalistic Observation

Jim Ross
Design Philadelphia: The Bleeding Edge of Design Research

October 16, 2013
User research is unnatural.

Covert Naturalistic Observation - Jim Ross

4
User research is unnatural.

Source: Flickr – Thomas Link

Covert Naturalistic Observation - Jim Ross

Source: Flickr – Thomas Link

5
User research is unnatural.

Covert Naturalistic Observation - Jim Ross

6
We get informed consent from participants.

Covert Naturalistic Observation - Jim Ross

7
But knowing that you’re being observed affects behavior.

Source: Flickr – Blue Oxen

Covert Naturalistic Observation - Jim Ross

8
Covert naturalistic observation

Source: Flickr – Sean Hobson
Covert Naturalistic Observation - Jim Ross

10
We usually use overt naturalistic observation.

Covert Naturalistic Observation - Jim Ross

11
It’s rare that we use covert naturalistic observation.

Source: Flickr – James Emery
Covert Naturalistic Observation - Jim Ross

12
Who uses covert naturalistic observation?

Covert Naturalistic Observation - Jim Ross

13
Who uses covert naturalistic observation?

Covert Naturalistic Observation - Jim Ross

14
Who uses covert naturalistic observation?

Covert Naturalistic Observation - Jim Ross

15
Covert naturalistic observation
It allows you to observe realistic, natural behavior.

Source: Flickr – David Hillowitz
Covert Naturalistic Observation - Jim Ross

17
Trying to remain covert makes observation more difficult.

Source: Flickr – Lars Plougmann
Covert Naturalistic Observation - Jim Ross

18
You can’t study interfaces or close up interactions.

Source: Flickr – Walter Lim
Covert Naturalistic Observation - Jim Ross

19
You can’t ask questions, so you rely on observation only.

Source: Flickr – Danielle Scott
Covert Naturalistic Observation - Jim Ross

20
Ethical concerns about consent, privacy, and deception

Source: Flickr – dustpuppy
Covert Naturalistic Observation - Jim Ross

21
Covert naturalistic observation
Studying behavior and interactions in a public place

Source: Flickr – Drew XXX
Source: Flickr – dustpuppy
Covert Naturalistic Observation - Jim Ross

23
Covert naturalistic observation
1. Plan what you want to observe.

Covert Naturalistic Observation - Jim Ross

25
2. Gather intelligence – do some research on:
•
•
•
•

The domain
User characteristics
Tasks and behaviors
Existing research

Covert Naturalistic Observation - Jim Ross

26
3. Scope out the location ahead of time: layout, people,
activity level.

Source: Flickr – Ben Salter
Covert Naturalistic Observation - Jim Ross

27
4. Consider notifying management and security.

Source: Flickr – Elvert Barnes
Covert Naturalistic Observation - Jim Ross

28
5. Observe with partners.

Source: Flickr – Carey Akin
Covert Naturalistic Observation - Jim Ross

29
6. Observe over several shorter sessions to see:
• More people
• Different situations
• Different time periods

Covert Naturalistic Observation - Jim Ross

30
6. Observe over several shorter sessions to avoid:
• Fatigue
• Information overload
• “Getting caught”

Covert Naturalistic Observation - Jim Ross

31
7. Blend in – dress like everyone else.

Source: Flickr – Michael Ocampo
Covert Naturalistic Observation - Jim Ross

32
7. Blend in – do what others are doing.

Source: Flickr – James Emery
Covert Naturalistic Observation - Jim Ross

33
7. Blend in – use a mobile device.

Source: Flickr – Elvert Barnes
Covert Naturalistic Observation - Jim Ross

Source: Flickr – Elvert Barnes
34
8. Don’t take obvious notes.

Source: Flickr – Geek Calendar
Covert Naturalistic Observation - Jim Ross

35
8. Don’t take obvious notes – use a phone or tablet.

Source: Flickr – Elvert Barnes
Covert Naturalistic Observation - Jim Ross

36
9. Treat recording as secondary – take photos or video
last.

Covert Naturalistic Observation - Jim Ross

37
9. Treat recording as secondary – use a phone or tablet.

Source: Flickr – Jesus Leon
Covert Naturalistic Observation - Jim Ross

38
9. Treat recording as secondary – don’t record audio.

Covert Naturalistic Observation - Jim Ross

39
10. Debrief after each observation session.

Source: Flickr – Sean MacEntee
Covert Naturalistic Observation - Jim Ross

40
10. Debrief after each observation session.

Covert Naturalistic Observation - Jim Ross

41
11. Do it ethically – observe in public places.

Source: Flickr – Dominic Alves
Covert Naturalistic Observation - Jim Ross

42
11. Do it ethically – focus on groups not individuals.

Source: Flickr – Alfonso Pierantonio
Covert Naturalistic Observation - Jim Ross

43
11. Do it ethically – protect privacy.

Source: Flickr – David Goehring
Covert Naturalistic Observation - Jim Ross

44
11. Do it ethically – don’t deceive.

Source: Flickr – Elvert Barnes
Covert Naturalistic Observation - Jim Ross

45
12. Combine it with other methods.

Covert Naturalistic Observation - Jim Ross

46
Covert naturalistic observation


Overt and covert methods each have
advantages and disadvantages.

Covert Naturalistic Observation - Jim Ross

48


With understanding of the advantages and
disadvantages, we can use overt and covert
methods as appropriate to best understand
the user experience.

Covert Naturalistic Observation - Jim Ross

49
Covert naturalistic observation

Jim Ross
Design Philadelphia: The Bleeding Edge of Design Research

October 16, 2013

Más contenido relacionado

Destacado

Quantitative reasearch.
Quantitative reasearch.Quantitative reasearch.
Quantitative reasearch.Rabina Yesmin
 
Merriam ch 9 5.25.10
Merriam ch 9 5.25.10Merriam ch 9 5.25.10
Merriam ch 9 5.25.10Daberkow
 
Qualitiative data analysis: data triangulation
Qualitiative data analysis: data triangulationQualitiative data analysis: data triangulation
Qualitiative data analysis: data triangulationAgnieszka Szóstek
 
sampling in research methodology. qualitative and quantitative approach
sampling in research methodology. qualitative and quantitative approach sampling in research methodology. qualitative and quantitative approach
sampling in research methodology. qualitative and quantitative approach Samantha Jayasundara
 
Ethnographic Research for Design Innovation
Ethnographic Research for Design InnovationEthnographic Research for Design Innovation
Ethnographic Research for Design InnovationCHI*Atlanta
 
Observation in Qualitative Research
Observation in Qualitative ResearchObservation in Qualitative Research
Observation in Qualitative Researchsheroz_ramzan
 
Non probability sampling 2
Non probability sampling 2Non probability sampling 2
Non probability sampling 2Sanket Gaikwad
 
Sampling1[1]
Sampling1[1]Sampling1[1]
Sampling1[1]jilly17
 
Sampling in qualitative research
Sampling in qualitative researchSampling in qualitative research
Sampling in qualitative researchDr. V Vorvoreanu
 
Quantitative And Qualitative Research
Quantitative And Qualitative ResearchQuantitative And Qualitative Research
Quantitative And Qualitative Researchdoha07
 
Research Methodology
Research MethodologyResearch Methodology
Research Methodologysh_neha252
 
Sampling and Sample Types
Sampling  and Sample TypesSampling  and Sample Types
Sampling and Sample TypesDr. Sunil Kumar
 
RESEARCH METHOD - SAMPLING
RESEARCH METHOD - SAMPLINGRESEARCH METHOD - SAMPLING
RESEARCH METHOD - SAMPLINGHafizah Hajimia
 
Qualitative and quantitative methods of research
Qualitative and quantitative methods of researchQualitative and quantitative methods of research
Qualitative and quantitative methods of researchJordan Cruz
 

Destacado (20)

Quantitative reasearch.
Quantitative reasearch.Quantitative reasearch.
Quantitative reasearch.
 
Types of research
Types of researchTypes of research
Types of research
 
Merriam ch 9 5.25.10
Merriam ch 9 5.25.10Merriam ch 9 5.25.10
Merriam ch 9 5.25.10
 
Qualitiative data analysis: data triangulation
Qualitiative data analysis: data triangulationQualitiative data analysis: data triangulation
Qualitiative data analysis: data triangulation
 
sampling in research methodology. qualitative and quantitative approach
sampling in research methodology. qualitative and quantitative approach sampling in research methodology. qualitative and quantitative approach
sampling in research methodology. qualitative and quantitative approach
 
Qualitative data collection
Qualitative data collectionQualitative data collection
Qualitative data collection
 
Ethnographic Research for Design Innovation
Ethnographic Research for Design InnovationEthnographic Research for Design Innovation
Ethnographic Research for Design Innovation
 
Observation in Qualitative Research
Observation in Qualitative ResearchObservation in Qualitative Research
Observation in Qualitative Research
 
Non probability sampling 2
Non probability sampling 2Non probability sampling 2
Non probability sampling 2
 
Design of qualitative research
Design of qualitative researchDesign of qualitative research
Design of qualitative research
 
Triangulation
Triangulation Triangulation
Triangulation
 
Sampling1[1]
Sampling1[1]Sampling1[1]
Sampling1[1]
 
Nonprobability Sampling
Nonprobability SamplingNonprobability Sampling
Nonprobability Sampling
 
Sampling in qualitative research
Sampling in qualitative researchSampling in qualitative research
Sampling in qualitative research
 
Quantitative And Qualitative Research
Quantitative And Qualitative ResearchQuantitative And Qualitative Research
Quantitative And Qualitative Research
 
Research Methodology
Research MethodologyResearch Methodology
Research Methodology
 
Sampling and Sample Types
Sampling  and Sample TypesSampling  and Sample Types
Sampling and Sample Types
 
RESEARCH METHOD - SAMPLING
RESEARCH METHOD - SAMPLINGRESEARCH METHOD - SAMPLING
RESEARCH METHOD - SAMPLING
 
Qualitative and quantitative methods of research
Qualitative and quantitative methods of researchQualitative and quantitative methods of research
Qualitative and quantitative methods of research
 
Types of Research
Types of ResearchTypes of Research
Types of Research
 

Último

Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Principled Technologies
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 

Último (20)

Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 

Covert Naturalistic Observation

  • 1. Jim Ross Design Philadelphia: The Bleeding Edge of Design Research October 16, 2013
  • 2. Covert Naturalistic Observation Jim Ross Design Philadelphia: The Bleeding Edge of Design Research October 16, 2013
  • 3.
  • 4. User research is unnatural. Covert Naturalistic Observation - Jim Ross 4
  • 5. User research is unnatural. Source: Flickr – Thomas Link Covert Naturalistic Observation - Jim Ross Source: Flickr – Thomas Link 5
  • 6. User research is unnatural. Covert Naturalistic Observation - Jim Ross 6
  • 7. We get informed consent from participants. Covert Naturalistic Observation - Jim Ross 7
  • 8. But knowing that you’re being observed affects behavior. Source: Flickr – Blue Oxen Covert Naturalistic Observation - Jim Ross 8
  • 9.
  • 10. Covert naturalistic observation Source: Flickr – Sean Hobson Covert Naturalistic Observation - Jim Ross 10
  • 11. We usually use overt naturalistic observation. Covert Naturalistic Observation - Jim Ross 11
  • 12. It’s rare that we use covert naturalistic observation. Source: Flickr – James Emery Covert Naturalistic Observation - Jim Ross 12
  • 13. Who uses covert naturalistic observation? Covert Naturalistic Observation - Jim Ross 13
  • 14. Who uses covert naturalistic observation? Covert Naturalistic Observation - Jim Ross 14
  • 15. Who uses covert naturalistic observation? Covert Naturalistic Observation - Jim Ross 15
  • 17. It allows you to observe realistic, natural behavior. Source: Flickr – David Hillowitz Covert Naturalistic Observation - Jim Ross 17
  • 18. Trying to remain covert makes observation more difficult. Source: Flickr – Lars Plougmann Covert Naturalistic Observation - Jim Ross 18
  • 19. You can’t study interfaces or close up interactions. Source: Flickr – Walter Lim Covert Naturalistic Observation - Jim Ross 19
  • 20. You can’t ask questions, so you rely on observation only. Source: Flickr – Danielle Scott Covert Naturalistic Observation - Jim Ross 20
  • 21. Ethical concerns about consent, privacy, and deception Source: Flickr – dustpuppy Covert Naturalistic Observation - Jim Ross 21
  • 23. Studying behavior and interactions in a public place Source: Flickr – Drew XXX Source: Flickr – dustpuppy Covert Naturalistic Observation - Jim Ross 23
  • 25. 1. Plan what you want to observe. Covert Naturalistic Observation - Jim Ross 25
  • 26. 2. Gather intelligence – do some research on: • • • • The domain User characteristics Tasks and behaviors Existing research Covert Naturalistic Observation - Jim Ross 26
  • 27. 3. Scope out the location ahead of time: layout, people, activity level. Source: Flickr – Ben Salter Covert Naturalistic Observation - Jim Ross 27
  • 28. 4. Consider notifying management and security. Source: Flickr – Elvert Barnes Covert Naturalistic Observation - Jim Ross 28
  • 29. 5. Observe with partners. Source: Flickr – Carey Akin Covert Naturalistic Observation - Jim Ross 29
  • 30. 6. Observe over several shorter sessions to see: • More people • Different situations • Different time periods Covert Naturalistic Observation - Jim Ross 30
  • 31. 6. Observe over several shorter sessions to avoid: • Fatigue • Information overload • “Getting caught” Covert Naturalistic Observation - Jim Ross 31
  • 32. 7. Blend in – dress like everyone else. Source: Flickr – Michael Ocampo Covert Naturalistic Observation - Jim Ross 32
  • 33. 7. Blend in – do what others are doing. Source: Flickr – James Emery Covert Naturalistic Observation - Jim Ross 33
  • 34. 7. Blend in – use a mobile device. Source: Flickr – Elvert Barnes Covert Naturalistic Observation - Jim Ross Source: Flickr – Elvert Barnes 34
  • 35. 8. Don’t take obvious notes. Source: Flickr – Geek Calendar Covert Naturalistic Observation - Jim Ross 35
  • 36. 8. Don’t take obvious notes – use a phone or tablet. Source: Flickr – Elvert Barnes Covert Naturalistic Observation - Jim Ross 36
  • 37. 9. Treat recording as secondary – take photos or video last. Covert Naturalistic Observation - Jim Ross 37
  • 38. 9. Treat recording as secondary – use a phone or tablet. Source: Flickr – Jesus Leon Covert Naturalistic Observation - Jim Ross 38
  • 39. 9. Treat recording as secondary – don’t record audio. Covert Naturalistic Observation - Jim Ross 39
  • 40. 10. Debrief after each observation session. Source: Flickr – Sean MacEntee Covert Naturalistic Observation - Jim Ross 40
  • 41. 10. Debrief after each observation session. Covert Naturalistic Observation - Jim Ross 41
  • 42. 11. Do it ethically – observe in public places. Source: Flickr – Dominic Alves Covert Naturalistic Observation - Jim Ross 42
  • 43. 11. Do it ethically – focus on groups not individuals. Source: Flickr – Alfonso Pierantonio Covert Naturalistic Observation - Jim Ross 43
  • 44. 11. Do it ethically – protect privacy. Source: Flickr – David Goehring Covert Naturalistic Observation - Jim Ross 44
  • 45. 11. Do it ethically – don’t deceive. Source: Flickr – Elvert Barnes Covert Naturalistic Observation - Jim Ross 45
  • 46. 12. Combine it with other methods. Covert Naturalistic Observation - Jim Ross 46
  • 48.  Overt and covert methods each have advantages and disadvantages. Covert Naturalistic Observation - Jim Ross 48
  • 49.  With understanding of the advantages and disadvantages, we can use overt and covert methods as appropriate to best understand the user experience. Covert Naturalistic Observation - Jim Ross 49
  • 50. Covert naturalistic observation Jim Ross Design Philadelphia: The Bleeding Edge of Design Research October 16, 2013