Presentation held by Giulio Caperdoni, Vidiemme COO, during MWF 2014. The speech covers Google Glass topics, the project GoogleGlass4LIS and Museum 2.0

1. MWF 2014
Wearable Technology for Museums

2. who we are? user experience and technology

3. Rokivo & Vidiemme
Rokivo Inc. is an American company based in New York
and Turin, specialized in user experience, or the design
of the experience on different types of screens
(computer, smartphone, tablet, etc..)
www.rokivo.com
#werok
Vidiemme Consulting Srl is an Italian company based in
Milan, key player in the digital context and focused on
technology innovation for web, mobile and wearables
www.vidiemme.it
#weroll
Rokivo and Vidiemme have brought to Italy one of the Google Glass Explorer Edition prototypes, the program
opened so far only to US residents with the objective to develop new apps for this revolutionary device.

4. the speaker
Giulio Caperdoni
COO
Vidiemme Consulting

5. the speaker
Valerio Saffirio
Founder
Rokivo

6. what does it mean to develop for Google Glass?

7. two options to develop on Glass
March 2013
November 2013
Mirror API
GDK
The Google Mirror API allows you to build webbased services, called Glassware, that interact
with Google Glass, but do not run on it.
The Glass Development Kit (GDK) is an add-on to
the Android SDK that lets you build Glassware that
runs directly on Glass.
Platform
independence
Common
infrastructure
Built-in
functionality
Real-time User
Interaction
Source: https://developers.google.com/glass/develop
Offline
Functionality
Access to
Hardware

8. focus on GDK
Android SDK
Layouts, view
and other UI
widgets
GPS, Sensors
and other
hardware
Activities,
services and
other building
block
GDK add-on
The GDK is an Android SDK add-on that contains APIs for Glass-specific features. By using the Android SDK and
GDK, you can leverage the vast array of Android APIs and also design an optimal user experience for Glass.
Voice
Cards
Gesture
Detector
Source: https://developers.google.com/glass/develop/gdk

9. why GDK is so important?
because it opens up endless possibilities
to leverage all the “senses” of the device
because it allows to add
functionalities, voice commands and
gestures
because it allows a better integration
with external services

10. designing for Glass
UI elements allow 3 pattern
types:
Glass has its own rules and guideline for design and use, that are
fundamentally different from existing mobile and desktop platforms and that
need to be taken into consideration when creating the user experience.
While computers and smartphones may store a medium to large quantity of
data, Glass works best with information that is simple, relevant, and current.
forever
last year
last month
now
Source: https://developers.google.com/glass/design/principles
• Static card - Displays
text, HTML, images, and
video. Static cards can
invoke live cards or
immersions
• Live card – Show content
that is important at the
current time and constantly
update to keep information
fresh and relevant
• Immersion - Customized UI
experiences that take over
a user's focus and display
outside of the timeline
experience

11. GOOGLEGLASS4LIS - museum for deaf

12. what the LIS language is?
The LIS is the Italian Sign Language used by those deaf people that cannot
speak or write Italian.
Every community may have its own sign language; the Italian one is different
from the one used in America for example and even in Italy there are different
“dialects”.
LIS is based on “signs”. Signs are the results of different
parameters:
Manual
Hand movements
Hands orientation
Place
Configuration
Non manual
Facial expression
Oral behavior
Posture
Each sign is obtained combining basic units of
meaning, called cheremes in Italian. Cheremes are ordered
in accordance to LIS specific syntactic rules.
“Mom’s car” becomes “Mom + Car + Hers”
Combining cheremes in new ways it is possible to create
new signs.

13. GoogleGlass4LIS
GoogleGlass4LIS
is the first experimental project to develop an App intended to
deaf people to provide a full and accessible museum experience
a project by
in collaboration with
sponsored by

14. the concept
PLAY

15. how does it work?
1
Within the museum
the deaf person wears
Google Glass and
looks at the statue of
interest
4
2
3
Google Glass
displays the avatar
on its display
GoogleGlass4LIS
App recognizes the
statue based on its
position
Information on the statue
are linked with the
corresponding translation
produced by the ATLAS
platform and rendered
through an avatar signing
the LIS

16. Statue of king Ramses II
…
Final User Experience

17. the ATLAS platform
GoogleGlass4LIS is based on the ATLAS (Automatic Translation into Sign Languages) platform, a huge project
started in 2009 funded by Regione Piemonte and the EU.
The platform is able to translate any Italian text or audio to LIS. The platform creates in real time an avatar
that can then be displayed on any digital device (smartphone, tablet and – of course – Google Glass).
SET of VOCABULARY
Input:
Subtitles
Audio
Audio/Video
Text*
Intermediate
Format
Weather forecast
Train station
Museum (to be created for the project)
…
“Signs” for the
virtual avatar
*ATLAS core

19. (r)evolutions
Build an App useful for many types of
deafness, disabilities or educational
needs: Subtitles for non-LIS speaking,
Children, Foreigners , …
Making the entire museum interactive
with indoor positioning systems

20. press release
Press Conference
Egyptian Antiquities Museum - Nov 11th
Torino
DOWNLOAD THE FULL PRESS RELEASE HERE

22. indoor positioning systems

23. indoor location and positioning
•
Bringing the power of GPS and maps
indoor
•
Tying digital information to physical places
•
Instead of punching a 3 digit number into a
handheld tour guide, you could walk up to a
painting, pull out your smartphone, and find
additional info right there waiting for you
•
No single technology is ubiquitous
•
There are trade-offs to each of the
technologies. WiFi is low cost and
ubiquitous, but not very accurate*;
high precision location usually requires
higher cost and infrastructure work
*High accuracy is considered to be 1 to 5
meters, medium accuracy is 6 to 10 meters, and
low accuracy is over 11 meters

24. WiFi fingerprinting
•
The localization technique is based on measuring the
intensity of the received WiFi signal and generating a
“fingerprint” for every different position
Accuracy
• medium
Availability
• ubiquitous
•
•
Glass compares its current WiFi fingerprint to
Fingerprint/Location database in order to find its position
The accuracy depends on the number of positions that have
been previously entered into the database
Glass issue
• WiFi signal sampling
frequency is much slower
than usual in order to
safeguard battery life
o localization takes
longer than with a
smartphone

25. beacons
•
They are low-cost gizmos that continually beam out a
Bluetooth signal, running for up to a year on a small watch
battery and located at defined positions within a building
Accuracy
• high
Availability
• iOS7 – Android 4.3
•
•
Beacons come in different formats - including small coin cell
powered devices and USB sticks - and software versions
A beacon could pinpoint an item’s location in a room
Glass issue
• Not compatible with
current Android version
(4.0.4)
• Temporary workaround:
1. Beacon is discovered
by the smartphone
paired with the Glass
2. Beacon Id is sent to
Glass by the
smartphone

26. contacts
Rokivo Inc.
talkto@rokivo.com - www.rokivo.com
244 Fifth Avenue Suite F263, New York, NY 10001
Rokivo Srl - Via Giolitti, 41 - 10123 Turin (TO)
Vidiemme Consulting Srl
info@vidiemme.it - www.vidiemme.it
Via Natale Battaglia, 8 - 20127 Milan (MI)
contacts
Valerio Saffirio
+39.3358485602/valerio.saffirio@rokivo.com
contacts
Giulio Caperdoni
+39.3489154293/giulio.caperdoni@vidiemme.it