EON Demo

1. Enter document name
Stepping into
Kinect and Augmented Reality
from EON Reality SG perspective
(Jay) Ying-Chieh HUANG
Research Engineer
jay@eonreality.com.sg
2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 1

2. Enter document name
Speaker Introduction
After facility is built
• 2002-2006 Bachelor in ECE
National Cheng Kung University, Taiwan
• 2008-2009 Research Assistant, TOUCH Center
• 2010-2011 Master in CS, SoC
National University of Singapore
• Present Research Engineer at EON Reality, SG
• Research Topic in AR, VR, and HCI
– Multitouch projects in TOUCH Center
– Kinect projects in NUS and EON Reality
Copyright 2011 EON Reality Inc. All rights reserved

3. Enter document name
Agenda
• EON Reality company overview
• EON Interact live demo
• EON Interact: Kinect solution introduction
• Interactive demo session
• EON Interact application (gesture and interaction) workflow
• Introduction to industrial AR project in EON
• Discussion and Internship opportunity
15/10/2011 3

4. Enter document name
Who We Are
Founded in 1999, privately held US corporation based in
Irvine, California with branches in Singapore, Sweden and 19
Interactive Digital Centers around the world.
World’s leading provider of a total solution (software,
applications and immersive displays) for interactive visualization
based on Virtual Reality technology.
Wide Customer acceptance in Education, Aerospace, Defense,
Energy and Manufacturing.
International Management, Board and Partners: diverse,
experienced and global team.
+15 years of R&D as base for own software platform.
Mission critical solutions for Simulation Based Learning, Training,
Sales & Marketing and Product Development.
Copyright 2011 EON Reality Inc. All rights reserved
4

5. Enter document name
Our Vision
Understand Faster Decide Better Remember Longer
Copyright 2011 EON Reality Inc. All rights reserved
5

6. Enter document name
Our Mission
I hear … I forget
I see… I remember
I do… I understand
Ancient Chinese proverb (Confucius)
Copyright 2011 EON Reality Inc. All rights reserved
6

7. Enter document name
What We Do
3D Visualization Software Online 3D Meetings
From BP, Virtually Prepared
3D Immersive Display Systems Consulting Services &
Customized Development
Copyright 2011 EON Reality Inc. All rights reserved
7

8. Enter document name
How We Do It
Display Systems
Enable content for publishing in different display formats from web to immersive
Displays with EON Viewer and immersive 3D systems
Applications
Develop complete Training, Sales & Marketing, Support & Collaborative applications with EON
application software
Development Software
Bring Products and 3D environments to life with EON Development software
Exchange data between CAD/3D/2D systems and EON
CAD / PDM
Autodesk, 3DS, Maya, Microstation, PTC, Siemens-Unigraphics, …
Copyright 2011 EON Reality Inc. All rights reserved 8

9. Enter document name
Immersive 3D Display Systems
Immersive Rooms (aka CAVE and ICube)
Flat and angular 3D Stereo displays
Concave and curved 3D stereo displays.
Copyright 2011 EON Reality Inc. All rights reserved 9

10. Enter document name
Holographic Displays
Copyright 2011 EON Reality Inc. All rights reserved 10

11. Enter document name
Commercial Customers
Copyright 2011 EON Reality Inc. All rights reserved
11

12. Enter document name
Academic Customers
Copyright 2011 EON Reality Inc. All rights reserved
12

13. Enter document name
Challenges with Traditional Training
Engage and motivate; “an educational software that is as
compelling as the best video game and as effective as a personal
tutor.”
Improve Retention; engage and excite with a “I see, I do”
approach. Perform training in a replica of the real-world
environment. Problem based learning.
Save costs; reduce travel cost, enable effective self-study
capabilities, avoid using expensive mock-ups,
Accelerate timelines; enable availability, improve training
productivity, reduce time.
Increase “hands-on” experience; train multiple times on
scenarios that in real life would be limited in accessibility.
Copyright 2011 EON Reality Inc. All rights reserved 13

14. Enter document name
What is HCI play here?
Entertainment Games vs. Serious Games
Kill time Save time
Training Efficiency
Safety
Productivity
Reduce carbon footprint
Copyright 2011 EON Reality Inc. All rights reserved
14

15. Enter document name
What can Serious Games Offer?
a way to share knowledge and
gain experience from “what-if’ scenarios
in a virtual 3D environment
Copyright 2011 EON Reality Inc. All rights reserved
15

16. Enter document name
Educational Value Add
“The delta between pre-
and post-lesson tests
was huge.
The group that received
its lesson
in 3D saw a
35 percent increase
in test scores.”
Tracey Masamoto, Director
for JTM Concepts
http://www.dlp.com/downloads/DLP-CaseStudy-Classroom3.pdf
Copyright 2011 EON Reality Inc. All rights reserved 16

17. Enter document name
Industry Value Add
“Studies have shown
that training retention
by virtual-world
trainees is 80% better
than that of groups
who undertake
traditional training.”
Brian Ralphs,
BP Technology Director.
Image from BP, “Virtually Prepared”
http://www.bp.com/liveassets/bp_internet/globalbp/globalbp_uk_english/reports_and_publications/frontiers
/STAGING/local_assets/pdf/bpf25_10-14_3dve.pdf
Copyright 2011 EON Reality Inc. All rights reserved 17

18. Enter document name
Key Success Criteria #1 Realism
Using EON Reality systems for more than 5 years for Product Visualization, Client Interaction and Sales and
Marketing activities.
Snapshots of EON Immersive Displays and 3D datasets used by Boeing.
Copyright 2011 EON Reality Inc. All rights reserved
18

19. Enter document name
Key Success Criteria #2 Interaction
Interactive 3D Training Application developed by EON Reality.
Copyright 2011 EON Reality Inc. All rights reserved 19

20. Enter document name
Key Success Criteria #3 Immersion
Virtual Training – Fully Immersive, Interactive and Realistic
Copyright 2011 EON Reality Inc. All rights reserved 20

21. Enter document name
Case Studies
2011-10-15 Copyright 2010 EON Reality.Inc All rights reserved 21

22. Enter document name
NTU Institute of Media Innovation (IMI), Singapore
NTU – Nanyang Technological University – is on of the premier universities in Asia ranked
amongst the top 10 in Asia according to 2011 QS World University Rankings by Engineering subjects
A newly completed (2011, July) innovative Immersive and
Interactive 3D Display System at IMI, headed by Prof. Nadia
THALMANN, will provide a center for world-class R&D
around interactive 3D technologies.
Round, 320 degrees, 3 x 8 m
20 Megapixels in stereoscopic 3D
Five (5) high-end projectors, each of them in HD Stereo
Very bright, totally of 50,000 lumens (5 x 10,000 lumens / proj)
Interactive 3D Stereo and cluster s/w (EON ICube software)
Research and Development platform (EON Ultra and EON SDK)
University Dept. exterior. Conceptual display design. Images showing construction phase (March 2011)
2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved
22

23. Enter document name
Installation and Curation Works– Before / After
Before After
Display area is outlined on existing floor. Screen mounted, a surrounding room is
constructed and mounts / truss for projectors.
2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved
23

24. TemasekEnter document name
Polytechnic, Singapore
School of Interactive Media,0Temasek Polytechnic, Singapore
Temasek Polytechnic (TP) is a significant contributor to the field of para-professional education in Singapore. It is a
pioneer in Problem-based Learning (PBL). The Polytechnic is a firm believer in forging partnerships with industry to
keep students close to current industry practice. TP currently offers 38 full-time diploma courses in the areas of
Applied Science, Business, Design, Engineering and Information Technology and over 40 part-time courses, up to
the Advanced Diploma level. For more information, please visit www.tp.edu.sg
2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 24

25. EnterUniSIM, Singapore
document name
SIM University, Singapore
- A first in Singapore: an interactive 3D
classroom in a secure environment,
combining rich 3D models
with video and PowerPoint
- Phase 1 consists of
Six (6) Lectures at 3h each
- Ninety (90) interactive 3D models
created by EON Reality
- Ability to use both in the actual
classroom, as well as enabling students
to log-in from home (“online version”)
- Ability for interactive self-studies
(“off-line version”)
2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 25

26. Chulalongkorn University, Thailand
Enter document name
Department of Architecture 0 Civil Engineering
and
Chulalongkorn University is the oldest in Thailand and has long been considered the country's most prestigious
university. At the Department of Civil Engineering, EON Reality in June 2011 completed the installation of an
turn-key EON ICube, 3-projector system for stereoscopic and interactive 3D presentations.
2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 26

27. Enter documentNorway
UMB, name
0
School of Architecture and Urban Planning, Oslo, Norway
Department of Landscape Architecture and Spatial Planning (ILP) at the Norwegian University of
Life Sciences (UMB) is active in the field of planning research, education and development of
methods and techniques in planning theories.
2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 27

28. SiMT, USA
Enter document name
School of Manufacturing and Technology
SiMT – Southeastern Institute of Manufacturing and Technology – http://www.simt.com
Specializing in the design, development and implementation of 3D/Virtual Reality business solutions for
sales, marketing, training, trade show presentations and other applications, the center works with
business and industry to develop immersive and interactive customer/employee experiences.
2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 28

29. Imperial College, UK
Enter document name
When Imperial College received a grant from the British Government to form Design London, a substructure to
the university, they collaborated with EON Reality on the creation of a Virtual Reality simulation environment.
2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 29

30. Psychology and Psychotherapy
Enter document name
Babes-Bolyai University, Romania
Project Description
• Psychotherapy using interactive 3D technologies, including EON ICube
EON Reality Solution
• EON ICube 4 walls
• EON Professional for application development
• Upgrade to 5 walls planned in 2011
Benefits
• Safe, controllable and repeatable exposure to scenarios
• Cost effectiveness
Client Statements
•"Virtual reality therapy corrects major limitations. Taking in account that in a virtual
environment you can at any time stop the process, you can control the medium and as a
therapist I have control over the reactions and behavior of the client,” said Professor
Daniel David.
2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 30

31. Medical Engineering and Psychology
Enter document name
University of Montreal - School of Medical Engineering and Psychology
Athlete’s Brain Training -
Video at http://www.youtube.com/watch?v=La-WRhYeMCw&feature=related
A new simulations system for rehabilitation and training of athletic performance and clinical populations, developed
by Professor Jocelyn Faubert's team will be immersed within the EON ICube, a technology that allows virtual
training in a natural and realistic environment.
2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 31

32. KCTCS, USA
Enter document name
Kentucky Community and Technical College System, USA
The KCTCS Interactive Digital Center is a solution center for workforce development and teaching and learning
applications and business and industry. It is a research and content development center that utilizes cutting edge
visualization technologies to create highly immersive and interactive simulation based learning
and training applications.
Working with the colleges’ multiple industry partners to create interactive visualization content for
partners for varying aspects of training their employees, i.e. Coal Academy (mining), Fire Commission
(fire science), etc. to begin to show the colleges the winning relationships for building self-sustaining
environments within the colleges.
http://www.kctcs.edu/system_initiatives/interactive-digital-center/about_us.aspx
2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 32

33. Enter document name
Future
Real-time collaboration in Immersive 3D Environment
A major Oil Corporation has
created a life-like virtual 3D
replica of the actual
production site which can be
shared in real-time through
EON Reality software – in
scale 1 : 1.
- Improve productivity, reduce costly mistakes
- Real-time Knowledge transfer
- Cross-discipline communication
- Real-time sharing of 3D data, Documents, Voice
- Remote training
- Remote maintenance guidance
- Reduce costs
- Reduce carbon footprint
- Reduce risk exposure (personnel)
33
Copyright 2011 EON Reality Inc. All rights reserved

34. Enter document name
Demos
Visual Feature
Eon Interact
• Video for EON Interact (Gu-qin “Ancient Musical Instrument”)
2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 34

35. Enter document name
Eon 7.6 Support - EON Experience Portal
EON Experience is an online interactive 3D library. A 3D store. There are Huge 3D
models library in EON Experience Portal.
http://www.eonexperience.com/EonModel/Main.aspx
 Over 2000 high quality 3D models at your disposal
 Integrated search function and simple object manipulation
 You can play them on web browser (IE, Chrome, Firefox)
 3D Component, 3D Scenes, Partner Content
15/10/2011 35

36. Enter document name
Eon 7.6 Support - EON Experience Portal
15/10/2011 36

37. Enter document name
Eon 7.6 Support - EON Creator
What is EON Creator
EON Creator is an easy to use tool that empowers users to instantly select from thousands of 3D
models to configure, customize, publish high-quality interactive 3D content and view it in 3D
stereoscopic mode. With EON Creator users can create engaging interactive learning simulations
for training, education and presentation purposes.
Features:
 Select and download your contents.
 Configure and customize your content.
 Build up your own Virtual Scenes.
 Upload the scenes on portal and share them with friends.
 Use your scenes to start up meeting online. (Eon Coliseum)
15/10/2011 37

38. Enter document name
Eon 7.6 Support - EON Creator
Getting started Overview: http://www.youtube.com/watch?v=QN5VXt2Ip3k
Video Tutorials: http://www.youtube.com/playlist?list=PLE3E91248F14DB3A8
15/10/2011 38

39. Enter document name
Outline for EON Interact
• Natural User Interface + 3D = EON Interact
• Showcase of EON Interact demo
– View Tracking / DSTA / BP / Medical Room
• Create your own interaction!
• How to create gestures?
• EON Avatar
• Workflow of Medical Room
15/10/2011 39

40. Enter document name
NUI + 3D = EON Interact
To create a seamless experience between the real world and the
Virtual World – there are a few things we need to do…
15/10/2011 40

41. Enter document name
OpenNIManager

42. Enter document name
OpenNITexture No calibration needed
• ConfigurationFile:
– OpenNIConfig.xml
• CalibrationFile:
– UserCalibration.bin
15/10/2011 42

43. Enter document name
NUI + 3D = EON Interact
Kinect Sensor
OpenNI framework
Skeleton Data Skeleton Control
RGB/Depth image
EON Studio
OpenNIManager User Interface
OpenNITexture
Interaction
15/10/2011 43

44. Enter document name
Showcase of EON Interact demo
• View Tracking
– Head tracking
• DSTA weapon demo
– Menu Interaction
• British Petroleum demo
– Valve Turning, Navigation, Clap
• Medical Room
– Full body tracking, Avatar control
15/10/2011 44

45. Enter document name
Create your own interaction!
15/10/2011 45

46. Enter document name
Prototypes for EON Interact
NearestUser Find the nearest person in the camera view
GetHand Returns the nearest user’s right hand or left hand,
relative to reference position (ex: Torso, Shoulder)
RightHand Animation hand with visual feedback and time
setting
HandsUp Active when hand position is above head position
CollisionCube Well-defined element for 3D user interface, such as
CollisionSphere button, virtual object, gestures, and interaction
trigger.
It can be used with Hand (RightHand prototype)
Others: CamOrientation, SkeletonControl, Navigation, Clap, ...etc

47. Enter document name
How to create gestures?
15/10/2011 47

48. Enter document name
EON Scripting
• Let’s learn Scripting from BP demo
– Valve Turning
– Navigation
– Clap
15/10/2011 48

49. Enter document name
Workflow of Medical Room
49
„See‟ inside of your own body.
49

50. Enter document name
Workflow of Medical Room
• Avatar
• Scene
• Interaction
– RightHand / Menu Selection
– Change mode (Avatar control / Menu Selection)
– Heart / Brain
• Gesture
– HandsUp
– Clap
– Touch
• Tricks - Hide Cursor on simulation started
15/10/2011 50

51. Enter document name
EON Avatar
15/10/2011 51

52. Enter document name
Bring the whole scene and object from online portal
15/10/2011 52

53. Enter document name
Motion Capture system and Virtual Glove
15/10/2011 53

54. Enter document name
Augmented Reality in EON SG
• Exxon Mobil and MBS video clip
15/10/2011 54

55. Enter document name
Internship Opportunity
After facility is built
• We are looking for interns
– Technical projects: Kinect, Vision-based body tracking,
Augmented Reality, mobile rendering, cloud rendering, sensors
– Usability test, HCI
– Project management
– Visual/concept/interaction designer
– or tell me how you can contribute
• Get industry experience from the VR/AR industry leader
• Employment opportunity
• Contact: Eng Tat KHOO, R&D Director, engtat@eonreality.com.sg
Copyright 2011 EON Reality Inc. All rights reserved 55

56. Enter document name
(Jay) Ying-Chieh HUANG
Q&A Research Engineer
jay@eonreality.com.sg
• Thanks for your feedback
https://docs.google.com/spreadsheet/viewform?formkey=dEw1R2Z3S042a
U50bUQ3a3pmeE5RbWc6MQ
• A real immersive experience will revolutionize the way people interact with the world.
virtual reality create, diminished reality simplify, and augmented reality reshape a better world.
15/10/2011 56