SlideShare una empresa de Scribd logo
1 de 42
Descargar para leer sin conexión
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!1
• Impact Activation Improves Rapid Key Pressing Mon 16.30-17.50 516E
• Neuromechanics of Button Press Tue 11:00-12:20 518AB
• Moving Target Selection: A Cue Integration Model Tue 11:00-12:20 518AB
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Watch carefully...
3
!2
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Watch carefully...
2
!3
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Watch carefully...
1
!4
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!5
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
A button press.
!6
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
10x slower

one button press

= approx. 100 ms
!7
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!8
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!9
Target
The ultimate button press: Input registration 

at the precise moment aligned with the intended timing.
Intended Point
Button press
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Keystroke itself

is continuous.
!10
but registration is on point in time.
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
• Activation point is the point of signal registration during button press.

• Activation point setting has became a design parameter.
Activation point
!11
Logitech Romer-G switch
https://www.logitechg.com/en-us/
articles/romer-g
Aimpad
http://aimpad.com/aimpad-vs-
flaretech/
Flaretech
https://wooting.helpscoutdocs.com/
article/28-flaretech-switch-mechanics
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!12
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Switch mechanism
!13
source: http://www.keyboardco.com/blog/index.php/2012/12/an-introduction-to-cherry-mx-mechanical-switches/ 

https://sitesdoneright.com/blog/2013/02/why-my-mechanical-computer-keyboard-is-better-than-your-keyboard
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
1.0
10 ms
2.0
3.0
4.0
(mm)
0.5
0
Displacement
Time(A)
Traditional Activation
(B)Fingertipforce
1.0
1.5
2.0 (N)
Impact Activation
compression release
Time
impact
Impact Activation
Activating a button at its impact point
!14
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!15
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Listen and tap

to the rhythm
!16
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!17
Displacement
* 100 keystrokes
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
AveragedDisplacement
Traditional Activation
Impact Activation
!18
-50 ms
-15 ms
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Rationale and hypothesis
• At the impact point, maximum energy is transferred to the mechanoreceptors of the
fingertip [14].

• When perceived timing matches with the stronger sensation, users should be better
able to calibrate their responses with the displayed stimulus [16]

• Hypothesis

• Better calibration of button pressing with IA

• The effect is more pronounced in fast tapping task. (less temporal noise [34])
!19
1.0
10 ms
2.0
3.0
4.0
(mm)
0.5
0
Displacement
Time(A)
Traditional Activation
(B)
Fingertipforce
1.0
1.5
2.0 (N)
Impact Activation
compression release
Time
impact
≈ strength of mechanoreceptor stimulation
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
The change seems subtle.
Is there any difference?
1.0
10 ms
2.0
3.0
4.0
(mm)
0.5
0
Displacement
Time(A)
Traditional Activation
(B)
Fingertipforce
1.0
1.5
2.0 (N)
Impact Activation
compression release
Time
impact
!20
10-20 ms
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Even 10 ms matters.
!21
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!22
* 10x slower
Target Zone (50 ms)
Key activation
Traditional Activation
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!23
* 10x slower
Target Zone (50 ms)
Key activation
Impact Activation
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Implementation
• "Analog" sensing is required

• Optical, force, capacitance, magnetic, etc.
!24
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Algorithm
• Algorithm: detecting the first local maxima in button press
!25
1.0
10 ms
2.0
3.0
4.0
(mm)
0.5
0
Displacement
Time
Fingertipforce
1.0
1.5
2.0 (N)
compression release
Time
impact
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Implementation - Physical
• Displacement sensing by magnet and hall-effect sensor.

• Scan rate: 542 Hz
!26
Magnet
Hall-effect sensor
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
-40 -20 0 20 40 60 80 100
50 ms
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Implementation - Touch
• Touch area sensing by capacitance change

• Scan rate: 542 Hz
!27
0
10
20
30
40
50
60
70
80
-40 -20 0 20 40 60 80 100 120
50 ms
Touch sensor

module
(MPR121)
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Experiment
• Goal: to assess the effect of Impact Activation in terms of temporal accuracy
!28
Target
Activation
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Task
• "Please try to activate the button WITHIN the target"
• "Maximize the number of successful trial"
• "Adjust your button press timing"
!29
Failure Success Failure
...Sound
Button press
Interval Target Width
Repeat x100
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!30
In this experiment, we measured...

• Success Rate

= # success trials / # total trials
• Mean Asynchrony

= mean of asynchronies 

(=time difference between input and the stimuli signal onset)
• Standard Deviation of Asynchrony
Mean Asynchrony
Data Analysis
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Experiment design
!31
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Results: success rate
!32
24.6% 27.0%
48.0%
37.1%
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
Physical Touch
Task Succss Rate
Traditional
Impact
94.9% increase
(23.4%p)
37.4% increase
(10.1%p)
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Result: Asynchrony
!33
Physical
Impact Activation Traditional Ac
+50
+100
+50
0
-50
-100
-150
+100
ms)Asynchrony(ms)
Target width = 50 ms 100 ms
Mean
Asynchrony
+-1 σ line
+-2 σ line
Interval Target Width
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Result: Asynchrony
!34
Physical
Impact Activation Traditional Ac
+50
0
-50
-100
-150
+100
ms)Asynchrony(ms)
Interval
200ms
300ms
400ms
500ms
600ms
Interval Target Width
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Result: Asynchrony
!35
Physical
Impact Activation Traditional Ac
+50
0
-50
-100
-150
+100
ms)Asynchrony(ms)
Interval Target Width
Slope
: Robustness against interval changes
Accuracy
: near-zero is better
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Result: Asynchrony
!36
Physical
Impact Activation Traditional Ac
+50
+100
+50
0
-50
-100
-150
+100
ms)Asynchrony(ms)
Interval Target Width
Variance (=precision)
: narrower one indicates better precision
±1σ ≈ 68%
±2σ ≈ 95%
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Result: Asynchrony
!37
Physical
Impact Activation Traditional Activation
Touch
Tone interval (from 200-600 ms)
Tone duration Mean asynchrony ±1σ ±2σ
+50
0
-50
-100
-150
+100
+50
0
-50
-100
-150
+100
Asynchrony(ms)Asynchrony(ms)
Physical
Impact Activation Traditional Activation
+50
0
-50
-100
-150
+100
Asynchrony(ms)Asynchrony(ms)
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Result: Asynchrony
!38
Physical
Impact Activation Traditional Activation
Touch
+50
0
-50
-100
-150
+100
+50
0
-50
-100
-150
+100
Asynchrony(ms)Asynchrony(ms)
• Accuracy
• Physical > Touch

• Impact > Traditional

• Slope
• Physical-Impact was the best

• Impact < Traditional
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Result: Asynchrony
!39
Physical
Impact Activation Traditional Activation
Touch
Tone interval (from 200-600 ms)
Tone duration Mean asynchrony ±1σ ±2σ
+50
0
-50
-100
-150
+100
+50
0
-50
-100
-150
+100
Asynchrony(ms)Asynchrony(ms)
• Variance
• Impact < Traditional
Tone interval (ms)
200 300 400 500 600 200 300 400 500 600
St.Dev.ofAsynchrony
80
(ms)
60
40
20
Tone duration = 50 ms Tone duration = 100 ms
Overall
Average
47.3
48.7
51.6
52.2
Physical
Impact
Physical
Traditional
Touch
Impact
Touch
Traditional
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Implications
• Analog keyswitch technology has advantages. 

• Deeper activation point is better for timing precision.

• Activation point setting becomes a design parameter.
!40
Logitech Romer-G switch
https://www.logitechg.com/en-us/
articles/romer-g
Aimpad
http://aimpad.com/aimpad-vs-
flaretech/
Flaretech
https://wooting.helpscoutdocs.com/
article/28-flaretech-switch-mechanics
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
Future challenges
• Limited to a specific modality combination: audio stimulus / visual feedback.

• Long-term adaptation has not been tested.

• Tested only two specific buttons (4 mm tactile button and zero-travel touch button)
and sensors (displacement and touch area).
!41
Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
!42
Questions?
Summary
• Set the right activation point is crucial.

• Impact Activation is a new principle of
activation regarding human tactile
perception.

• Impact Activation improves both temporal
accuracy (2x success rate) and precision.
Physical
Impact Activation Traditional Activation
Touch
+50
0
-50
+100
+50
0
-50
-100
-150
+100
ynchrony(ms)Asynchrony(ms)
• Impact Activation Improves Rapid Key Pressing Mon 16.30-17.50 516E
• Neuromechanics of Button Press Tue 11:00-12:20 518AB
• Moving Target Selection: A Cue Integration Model Tue 11:00-12:20 518AB
I'm looking for job! http://kuaa.net

Más contenido relacionado

Último

How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 

Último (20)

How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 

Destacado

Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 

Destacado (20)

Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 

Impact Activation Improves Temporal Accuracy of Rapid Button Presses

  • 1. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !1 • Impact Activation Improves Rapid Key Pressing Mon 16.30-17.50 516E • Neuromechanics of Button Press Tue 11:00-12:20 518AB • Moving Target Selection: A Cue Integration Model Tue 11:00-12:20 518AB
  • 2. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Watch carefully... 3 !2
  • 3. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Watch carefully... 2 !3
  • 4. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Watch carefully... 1 !4
  • 5. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !5
  • 6. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 A button press. !6
  • 7. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 10x slower
 one button press
 = approx. 100 ms !7
  • 8. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !8 Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
  • 9. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !9 Target The ultimate button press: Input registration 
 at the precise moment aligned with the intended timing. Intended Point Button press
  • 10. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Keystroke itself
 is continuous. !10 but registration is on point in time.
  • 11. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 • Activation point is the point of signal registration during button press. • Activation point setting has became a design parameter. Activation point !11 Logitech Romer-G switch https://www.logitechg.com/en-us/ articles/romer-g Aimpad http://aimpad.com/aimpad-vs- flaretech/ Flaretech https://wooting.helpscoutdocs.com/ article/28-flaretech-switch-mechanics
  • 12. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !12 Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
  • 13. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Switch mechanism !13 source: http://www.keyboardco.com/blog/index.php/2012/12/an-introduction-to-cherry-mx-mechanical-switches/ 
 https://sitesdoneright.com/blog/2013/02/why-my-mechanical-computer-keyboard-is-better-than-your-keyboard
  • 14. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 1.0 10 ms 2.0 3.0 4.0 (mm) 0.5 0 Displacement Time(A) Traditional Activation (B)Fingertipforce 1.0 1.5 2.0 (N) Impact Activation compression release Time impact Impact Activation Activating a button at its impact point !14
  • 15. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !15 Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
  • 16. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Listen and tap
 to the rhythm !16
  • 17. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !17 Displacement * 100 keystrokes
  • 18. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 AveragedDisplacement Traditional Activation Impact Activation !18 -50 ms -15 ms
  • 19. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Rationale and hypothesis • At the impact point, maximum energy is transferred to the mechanoreceptors of the fingertip [14]. • When perceived timing matches with the stronger sensation, users should be better able to calibrate their responses with the displayed stimulus [16] • Hypothesis • Better calibration of button pressing with IA • The effect is more pronounced in fast tapping task. (less temporal noise [34]) !19 1.0 10 ms 2.0 3.0 4.0 (mm) 0.5 0 Displacement Time(A) Traditional Activation (B) Fingertipforce 1.0 1.5 2.0 (N) Impact Activation compression release Time impact ≈ strength of mechanoreceptor stimulation
  • 20. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 The change seems subtle. Is there any difference? 1.0 10 ms 2.0 3.0 4.0 (mm) 0.5 0 Displacement Time(A) Traditional Activation (B) Fingertipforce 1.0 1.5 2.0 (N) Impact Activation compression release Time impact !20 10-20 ms
  • 21. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Even 10 ms matters. !21
  • 22. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !22 * 10x slower Target Zone (50 ms) Key activation Traditional Activation
  • 23. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !23 * 10x slower Target Zone (50 ms) Key activation Impact Activation
  • 24. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Implementation • "Analog" sensing is required • Optical, force, capacitance, magnetic, etc. !24
  • 25. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Algorithm • Algorithm: detecting the first local maxima in button press !25 1.0 10 ms 2.0 3.0 4.0 (mm) 0.5 0 Displacement Time Fingertipforce 1.0 1.5 2.0 (N) compression release Time impact
  • 26. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Implementation - Physical • Displacement sensing by magnet and hall-effect sensor. • Scan rate: 542 Hz !26 Magnet Hall-effect sensor 0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 -40 -20 0 20 40 60 80 100 50 ms
  • 27. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Implementation - Touch • Touch area sensing by capacitance change • Scan rate: 542 Hz !27 0 10 20 30 40 50 60 70 80 -40 -20 0 20 40 60 80 100 120 50 ms Touch sensor
 module (MPR121)
  • 28. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Experiment • Goal: to assess the effect of Impact Activation in terms of temporal accuracy !28 Target Activation
  • 29. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Task • "Please try to activate the button WITHIN the target" • "Maximize the number of successful trial" • "Adjust your button press timing" !29 Failure Success Failure ...Sound Button press Interval Target Width Repeat x100 Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018
  • 30. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !30 In this experiment, we measured... • Success Rate
 = # success trials / # total trials • Mean Asynchrony
 = mean of asynchronies 
 (=time difference between input and the stimuli signal onset) • Standard Deviation of Asynchrony Mean Asynchrony Data Analysis
  • 31. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Experiment design !31
  • 32. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Results: success rate !32 24.6% 27.0% 48.0% 37.1% 0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0% Physical Touch Task Succss Rate Traditional Impact 94.9% increase (23.4%p) 37.4% increase (10.1%p)
  • 33. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Result: Asynchrony !33 Physical Impact Activation Traditional Ac +50 +100 +50 0 -50 -100 -150 +100 ms)Asynchrony(ms) Target width = 50 ms 100 ms Mean Asynchrony +-1 σ line +-2 σ line Interval Target Width
  • 34. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Result: Asynchrony !34 Physical Impact Activation Traditional Ac +50 0 -50 -100 -150 +100 ms)Asynchrony(ms) Interval 200ms 300ms 400ms 500ms 600ms Interval Target Width
  • 35. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Result: Asynchrony !35 Physical Impact Activation Traditional Ac +50 0 -50 -100 -150 +100 ms)Asynchrony(ms) Interval Target Width Slope : Robustness against interval changes Accuracy : near-zero is better
  • 36. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Result: Asynchrony !36 Physical Impact Activation Traditional Ac +50 +100 +50 0 -50 -100 -150 +100 ms)Asynchrony(ms) Interval Target Width Variance (=precision) : narrower one indicates better precision ±1σ ≈ 68% ±2σ ≈ 95%
  • 37. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Result: Asynchrony !37 Physical Impact Activation Traditional Activation Touch Tone interval (from 200-600 ms) Tone duration Mean asynchrony ±1σ ±2σ +50 0 -50 -100 -150 +100 +50 0 -50 -100 -150 +100 Asynchrony(ms)Asynchrony(ms) Physical Impact Activation Traditional Activation +50 0 -50 -100 -150 +100 Asynchrony(ms)Asynchrony(ms)
  • 38. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Result: Asynchrony !38 Physical Impact Activation Traditional Activation Touch +50 0 -50 -100 -150 +100 +50 0 -50 -100 -150 +100 Asynchrony(ms)Asynchrony(ms) • Accuracy • Physical > Touch • Impact > Traditional • Slope • Physical-Impact was the best • Impact < Traditional
  • 39. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Result: Asynchrony !39 Physical Impact Activation Traditional Activation Touch Tone interval (from 200-600 ms) Tone duration Mean asynchrony ±1σ ±2σ +50 0 -50 -100 -150 +100 +50 0 -50 -100 -150 +100 Asynchrony(ms)Asynchrony(ms) • Variance • Impact < Traditional Tone interval (ms) 200 300 400 500 600 200 300 400 500 600 St.Dev.ofAsynchrony 80 (ms) 60 40 20 Tone duration = 50 ms Tone duration = 100 ms Overall Average 47.3 48.7 51.6 52.2 Physical Impact Physical Traditional Touch Impact Touch Traditional
  • 40. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Implications • Analog keyswitch technology has advantages. • Deeper activation point is better for timing precision. • Activation point setting becomes a design parameter. !40 Logitech Romer-G switch https://www.logitechg.com/en-us/ articles/romer-g Aimpad http://aimpad.com/aimpad-vs- flaretech/ Flaretech https://wooting.helpscoutdocs.com/ article/28-flaretech-switch-mechanics
  • 41. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 Future challenges • Limited to a specific modality combination: audio stimulus / visual feedback. • Long-term adaptation has not been tested. • Tested only two specific buttons (4 mm tactile button and zero-travel touch button) and sensors (displacement and touch area). !41
  • 42. Sunjun Kim, Byungjoo Lee, Antti Oulasvirta, Impact Activation Improves Rapid Button Pressing, CHI 2018 !42 Questions? Summary • Set the right activation point is crucial. • Impact Activation is a new principle of activation regarding human tactile perception. • Impact Activation improves both temporal accuracy (2x success rate) and precision. Physical Impact Activation Traditional Activation Touch +50 0 -50 +100 +50 0 -50 -100 -150 +100 ynchrony(ms)Asynchrony(ms) • Impact Activation Improves Rapid Key Pressing Mon 16.30-17.50 516E • Neuromechanics of Button Press Tue 11:00-12:20 518AB • Moving Target Selection: A Cue Integration Model Tue 11:00-12:20 518AB I'm looking for job! http://kuaa.net