IXDA 2014
EVANGELIZING & DESIGNING VOICE USER INTERFACE
ADOPTING VUI
IN A GUI WORLD
FEBRUARY 8, 2014
STEPHEN GAY
SUSAN HURA

OUR STORY
IXDA 2014
@stephengay @speechusability

TODAY
IXDA 2014
@stephengay @speechusability

Interactions with technology
EVOLUTION
Command Line
Interface
(CLI)
Graphical User
Interface
(GUI)
Natural User
Interface
(NUI)
Voice User
Interface
(VUI)
Time
IXDA 2014
@stephengay @speechusability

AN ALTERNATIVE HISTORY
Time
IXDA 2014
@stephengay @speechusability

NATURAL = HUMAN
Audible
Feedback
IXDA 2014
Voice
Control
@stephengay @speechusability

HER
IXDA 2014
@stephengay @speechusability

DEFINE
A VUI ENABLES PEOPLE TO USE
THEIR VOICES AND INNATE
LANGUAGE SKILLS TO INTERACT
WITH TECHNOLOGY.

THE SPEECH CHAIN
Amsterdam
IXDA 2014
@stephengay @speechusability

THE SPEECH CHAIN
IXDA 2014
@stephengay @speechusability

THE SPEECH CHAIN
ASR
Automatic Speech Recognition
= Sounds to Words
Idea
Sound
Idea
NLU
Natural Language Understanding
= Words to Meaning
IXDA 2014
@stephengay @speechusability

TYPES OF INTERACTIONS

Integration Complexity
TYPES OF INTERACTION
Customer Benefit
IXDA 2014
@stephengay @speechusability

THE SECRETARY
Recognize what is being said and record it
IXDA 2014
@stephengay @speechusability

THE SECRETARY
Recognize what is being said and record it
IXDA 2014
@stephengay @speechusability

THE BOUNCER
Recognize who is speaking
IXDA 2014
@stephengay @speechusability

THE BOUNCER
Recognize who is speaking
IXDA 2014
@stephengay @speechusability

THE BOUNCER
IXDA 2014
@stephengay @speechusability

THE GOPHER
Execute simple orders
IXDA 2014
@stephengay @speechusability

THE GOPHER
Execute simple orders
IXDA 2014
@stephengay @speechusability

FEBRUARY 8, 2014

THE PERSONAL ASSISTANT
Intelligently respond to natural language input
IXDA 2014
@stephengay @speechusability

THE PERSONAL ASSISTANT
Intelligently respond to natural language input
IXDA 2014
@stephengay @speechusability

THE PERSONAL ASSISTANT
IXDA 2014
@stephengay @speechusability

THE PERSONAL ASSISTANT
IXDA 2014
@stephengay @speechusability

FEBRUARY 8, 2014

GOTCHA
IXDA 2014
@stephengay @speechusability

OPPORTUNTIES

OPPORTUNTIES
Hands Free
IXDA 2014
Extra Hand
Shortcuts
Humanize
@stephengay @speechusability

HANDS FREE
IXDA 2014
@stephengay @speechusability

FEBRUARY 8, 2014

EXTRA HAND
IXDA 2014
@stephengay @speechusability

HANDSFREE
IXDA 2014
@stephengay @speechusability

SHORTCUTS
IXDA 2014
@stephengay @speechusability

SHORTCUTS
IXDA 2014
@stephengay @speechusability

HUMANIZE
IXDA 2014
@stephengay @speechusability

FEBRUARY 8, 2014

BRAINSTORM
IXDA 2014
@stephengay @speechusability

PRINCIPLES

PRINCIPLES
IT’S DIFFERENT
DESIGNING FOR SPEECH
IXDA 2014
@stephengay @speechusability

BE MULTI-MODAL
VUI + GUI
IXDA 2014
@stephengay @speechusability

HOW TO BE A GREAT CONVERSATIONALIST
1. Be a good machine
3. Be trustworthy
Own the strengths and limitations of
automated conversation.
Follow conversational maxims and
ensure that users can too.
2. Take turns
Give strong cues for when its time to
talk and listen. Show that you’re
listening, through both words and
actions.
IXDA 2014
4. Be tolerant
Be tolerant of natural disfluencies.
@stephengay @speechusability

BE A GOOD MACHINE
IXDA 2014
@stephengay @speechusability

TAKE TURNS
IXDA 2014
@stephengay @speechusability

TAKE TURNS
IXDA 2014
@stephengay @speechusability

BE TOLERANT
IXDA 2014
@stephengay @speechusability

BE TRUSTWORTHY
IXDA 2014
@stephengay @speechusability

BE TRUSTWORTHY
IXDA 2014
@stephengay @speechusability

EVANGELIZE

EVANGELIZE VUI
1.
2.
3.
4.
5.
IXDA 2014
Jump on a train in motion.
Know your audience.
Build a foundation of knowledge.
Make it tangible.
Make it their own.
CON 5
@stephengay @speechusability

DOWNLOAD THE PPT AND MATERIAL
@STEPHENGAY
IXDA 2014
@stephengay @speechusability