1.
AUGMENTED REALITY
& HCI-KINECT
HUMAN COMPUTER INTERACTION
AUGMENTED REALITY BARCELONA - MEETUP-03
2013-december-12
La Salle Campus Barcelona
03
ISIDRO NAVARRO
AR & VR - Architect

2.
By ISIDRO NAVARRO
INTRODUCTION
#meetupARHCI
Augmented Reality & HCI-KINECT
• Introduction
– ‘Augmented Reality Barcelona’
– Blogs, Communities and Groups
•
•
•
•
•
HCI
Research
Industry
Applications
Related Themes
AUGMENTED REALITY BARCELONA
2

3.
By ISIDRO NAVARRO
INTRODUCTION
Augmented Reality Barcelona
Who we are?
...more than 110 members from more than 35 entities
La Salle, LAYAR, Catchoom, Engidia, INAR, Tetravol, Mitjans
Digitals, TSystems, Alt64, Bienetec, Aumentaty, Namastech, MKTCultural, A
ugmate, BOC, Ltc&group, EspiRA, Funky Whale
Games, BeMyApp, FoolHead Studio, FEZOO, TEF, Medialab
Barcelona, PANGEA Reality, Iris Control Systems, Mobile World
Center, Innovae Vision, UPC, Aumentasolutions, AR Dirt
Podcast, Doubleyou, Amplified Robot, Merchlar, Boston
Scientific, Einnova, AR Standards, ENTI,…
AUGMENTED REALITY BARCELONA
3
#meetupARHCI
Augmented Reality & HCI-KINECT

4.
Augmented Reality & HCI-KINECT
By ISIDRO NAVARRO
INTRODUCTION
#meetupARHCI
BLOGS & PEOPLE
http://www.ardirt.com
http://augmentedpixels.com/blog/
http://augmentation.wordpress.com
http://augmentedblog.wordpress.com
http://www.augmented.org/blog
http://www.augmentedlegality.com
http://gamesalfresco.com
http://medicalaugmentedreality.com
http://augmentedrealityoverview.blogspot.com
AUGMENTED REALITY BARCELONA
4

5.
Augmented Reality & HCI-KINECT
By ISIDRO NAVARRO
INTRODUCTION
AUGMENTED REALITY BARCELONA
#meetupARHCI
COMMUNITIES in Google+
5

6.
Augmented Reality & HCI-KINECT
By ISIDRO NAVARRO
INTRODUCTION
#meetupARHCI
GROUPS in Linkedin
Mobile Augmented Reality (3500+)
AR Glasses (2700+)
Immersive 3D Environments & Augmented Reality (1000+)
Geospatial Augmented Reality (400+)
Layar Reality Browser (400+)
AR-UX : Augmented Reality User Experience (250+)
ARE: Augmented Reality Educators (50+)
La Salle AR (40+)
AUGMENTED REALITY BARCELONA
6

7.
By ISIDRO NAVARRO
INTRODUCTION
AR market studies
Virtual Reality & Augmented Reality Market worth 1.06 Billion by
2018
“Virtual Reality & Augmented Reality Market – By Technology (Mobile &
Spatial AR, Semi & Fully Immersive VR); By Sensors & Components
(Accelerometer, Data Glove, HMD, ICs); By Applications
(Medical, Military, Gaming), By Geography (2013 – 2018) ”, published by
MarketsandMarkets
WEB
AUGMENTED REALITY BARCELONA
7
#meetupARHCI
Augmented Reality & HCI-KINECT

8.
Augmented Reality & HCI-KINECT
HUMAN COMPUTER INTERACTION
CONCEPT
#meetupARHCI
By ISIDRO NAVARRO
Human-Computer Interaction (HCI)
is a discipline concerned with the
design, evaluation and
implementation of interactive
computing systems for human use
and with the study of major
phenomena surrounding them.
1992, SIGCHI Curriculum Development Group
AUGMENTED REALITY BARCELONA
8

9.
Augmented Reality & HCI-KINECT
SIXTHSENSE - MIT Media Lab
Haptic System
'SixthSense' is a wearable gestural interface that augments the physical world
around us with digital information and lets us use natural hand gestures to
interact with that information. Author: Pranav Mistry
WEB
VIDEO
AUGMENTED REALITY BARCELONA
9
#meetupARHCI
RESEARCH
By ISIDRO NAVARRO

10.
Augmented Reality & HCI-KINECT
OCULUS RIFT & Motion Capture System
This projects details a stereo camera rig that I've built for the Oculus Rift, and
showcases a series of augmented reality demonstrations. The video also
covers a method to use the Rift wirelessly (Virtual Environments and
Computer Graphics group at University College London)
Author: William Steptoe
WEB
VIDEO
AUGMENTED REALITY BARCELONA
10
#meetupARHCI
RESEARCH
By ISIDRO NAVARRO

11.
Augmented Reality & HCI-KINECT
SANDBOX – KeckCAVES
Science education, Keck Foundation, California
The sandbox is equipped with a Kinect 3D camera and a projector to project a
real-time colored topographic map with contour lines onto the sand surface.
The sandbox lets virtual water flow over the surface using a GPU-based
simulation of the Saint-Venant set of shallow water equations.
Authors: Oliver Kreylos, Buraz Yikilmaz & Peter Gold from KeckCAVES
VIDEO
WEB
AUGMENTED REALITY BARCELONA
11
#meetupARHCI
RESEARCH
By ISIDRO NAVARRO

12.
Augmented Reality & HCI-KINECT
RESEARCH
By ISIDRO NAVARRO
#meetupARHCI
REALITY EDITOR - MIT Media Lab
Internet Of Things
The Reality Editor is a system that supports editing the behavior and
interfaces of socalled “smarter objects”, i.e. objects or devices that have an
embedded processor and communication capability. Author: Valentin Heun
WEB
VIDEO
AUGMENTED REALITY BARCELONA
12

13.
By ISIDRO NAVARRO
RESEARCH
Gestural Interface for Remote Spatial Perception
Wearable device GIST helps the blind ‘see’ what’s around them.
Authors: Vinitha Khambadkar and Eelke Folmer are computer scientists from
the University of Nevada
WEB
VIDEO
AUGMENTED REALITY BARCELONA
13
#meetupARHCI
Augmented Reality & HCI-KINECT

14.
Augmented Reality & HCI-KINECT
Kinect Sign Language Translator – Microsoft Research
The prototype system understands the gestures of sign language
It displays the signer and renders a written and spoken translation of the sign
language in real-time, and it also takes the non-signer's spoken words and
turns them into accurate, understandable sign language.
Author: Xilin Cen, Professor, Chinese Academy of Sciences
WEB
VIDEO
AUGMENTED REALITY BARCELONA
14
#meetupARHCI
RESEARCH
By ISIDRO NAVARRO

15.
Augmented Reality & HCI-KINECT
RESEARCH
By ISIDRO NAVARRO
#meetupARHCI
inFORM – MIT
Dynamic Shape Display
inFORM can render 3D content
physically, so users can interact with digital
information in a tangible way. It also
interact with the physical world around
it, for example moving objects on the
table's surface. Remote participants in a
video conference can be displayed
physically, allowing for a strong sense of
presence and the ability to interact
physically at a distance.
Authors: Daniel Leithinger, Sean Follmer &
Hiroshi Ishii from MIT
VIDEO
AUGMENTED REALITY BARCELONA
WEB
15

16.
Augmented Reality & HCI-KINECT
PRIMESENSE labs
SMART TERRAIN
Apps powered by Vuforia can now enable users to create their own play space
and interact with the physical world in ways not experienced before by
enabling game physics to apply to real world surfaces and objects.
WEB
VIDEO
AUGMENTED REALITY BARCELONA
16
#meetupARHCI
INDUSTRY
By ISIDRO NAVARRO

17.
Augmented Reality & HCI-KINECT
OMEK
OMEK BECKON & GRASP
Omek Beckon and Grasp are a full-featured set of middleware and tools that
enables you to quickly and efficiently deploy full-body and hands gesture and
tracking interfaces in your applications and devices, for operation at ranges
from 1.5 to 3.5 meters and 10 cm.
VIDEO
WEB
AUGMENTED REALITY BARCELONA
17
#meetupARHCI
INDUSTRY
By ISIDRO NAVARRO

18.
By ISIDRO NAVARRO
INDUSTRY
XBOX ONE – Microsoft
Kinect-Game
The console includes a newly upgraded Kinect motion sensing peripheral.
New features such as a built-in Skype client for videoconferencing, user
recognition and tracking, and the ability to use voice commands and gestures
to navigate the console's user interface.
VIDEO
AUGMENTED REALITY BARCELONA
18
#meetupARHCI
Augmented Reality & HCI-KINECT

19.
Augmented Reality & HCI-KINECT
By ISIDRO NAVARRO
INDUSTRY
#meetupARHCI
PLAYGROUND – Playstation 4
Player interaction for immersive gaming.
The Playroom, an alternate reality game that comes pre-loaded on
PlayStation 4 projects the miniature machines into players' living rooms.
Using the PlayStation Camera, players can interact with
them, kicking, flicking, and cradling them as they frolic and cower.
VIDEO
AUGMENTED REALITY BARCELONA
19

20.
By ISIDRO NAVARRO
INDUSTRY
RAZER HYDRA – Sixense Entertainment
Magnetic motion sensing
It uses a weak magnetic field to detect the absolute position and orientation
of the controllers with a precision, as stated by its developers, of 1 mm and
1°; it has six degrees of freedom. The current release is wired, but a wireless
version is in development.
VIDEO
AUGMENTED REALITY BARCELONA
20
#meetupARHCI
Augmented Reality & HCI-KINECT

21.
By ISIDRO NAVARRO
INDUSTRY
REACTIVE GRIP – Tactical Haptics
Friction controller
Reactive Grip touch feedback works by mimicking the friction and shear
forces that we feel in the real world when holding an object or touching a
surface. This is accomplished by measuring the movements of the player’s
hand and actuating small sliding plates in the grip of the controller to recreate
the friction and shear forces you expect
VIDEO
AUGMENTED REALITY BARCELONA
21
#meetupARHCI
Augmented Reality & HCI-KINECT

22.
Augmented Reality & HCI-KINECT
STREET MARKETING - Appshaker
Interaction in public spaces for street marketing.
Projects using augmented reality, motion/body tracking and gesture control.
WEB
VIDEO
AUGMENTED REALITY BARCELONA
22
#meetupARHCI
APPLICATIONS
By ISIDRO NAVARRO

23.
Augmented Reality & HCI-KINECT
LEAP MOTION & Kinect
The Leap Motion controller senses how users moves their hands
over the device.
Author: Yhosinaga Takashi
WEB
VIDEO
AUGMENTED REALITY BARCELONA
23
#meetupARHCI
APPLICATIONS
By ISIDRO NAVARRO

24.
Augmented Reality & HCI-KINECT
IRIS – Hybe
Interactive mirror with Arduino and Kinect
RIS is a media canvas with matrix of conventional information display
technology - a monochrome LCD. Through the phased opening and closing of
circular-segmented black Liquid Crystal, IRIS can create various patterns and
control the amount (size) of passing lights. Seoul Art
Space_Geumcheon, KOREA
VIDEO
AUGMENTED REALITY BARCELONA
24
#meetupARHCI
RELATED THEMES
By ISIDRO NAVARRO

25.
Augmented Reality & HCI-KINECT
EYEBORG – Cyborg Foundation
Eyeborg is a cybernetic eye that allows you to hear colours from
infrared to ultraviolet.
The current eye is based on a chip that transmits sounds via bone conduction.
Author: Neil Harbisson
WEB
VIDEO
AUGMENTED REALITY BARCELONA
25
#meetupARHCI
RELATED THEMES
By ISIDRO NAVARRO

26.
Augmented Reality & HCI-KINECT
EPOC nuroheadset - EMOTIV
EMOTIV + KINECT CONTROLLED ROBOT
The Microsoft Kinect RGB-Depth camera overlays the floor in relation to the
robot's position and orientation. The user selects a location on the floor with
the mouse by moving his head.
WEB
VIDEO
AUGMENTED REALITY BARCELONA
26
#meetupARHCI
RELATED THEMES
By ISIDRO NAVARRO

27.
Augmented Reality & HCI-KINECT
RELATED THEMES
By ISIDRO NAVARRO
#meetupARHCI
OLIMPIC CHANGES
Contest for the best idea of projects about the olimpic winter
games in Rusia.
People interacts with the tickets machine to get it for free while they do
sport.
WEB
VIDEO
AUGMENTED REALITY BARCELONA
27

28.
Augmented Reality & HCI-KINECT
NEUROCAM – Neurowear
Wearable camera system that detects your emotions.
It automatically records moments of interest based on an analysis of the users
brainwaves..
Author: Mitsukura, professor of Keio University
WEB
VIDEO
AUGMENTED REALITY BARCELONA
28
#meetupARHCI
RELATED THEMES
By ISIDRO NAVARRO

29.
Augmented Reality & HCI-KINECT
RELATED THEMES
By ISIDRO NAVARRO
#meetupARHCI
SHIPPO – Neurowear & Kiluck
Neuro tagging map – Wearable device registers your emotions and tag
the map for sharing in social apps.
WEB
VIDEO
AUGMENTED REALITY BARCELONA
29

30.
Augmented Reality & HCI-KINECT
#meetupARHCI
By ISIDRO NAVARRO
ISIDRO NAVARRO
LinkedIn
Youtube
Slideshare
Google+
Twitter
Facebook
Scholar
Meetup
AUGMENTED REALITY BARCELONA
30