SlideShare una empresa de Scribd logo
1 de 41
Descargar para leer sin conexión
Utilizing Kinect Control for a More
Immersive Interaction with 3D
Environments
Supervised by
Dr. Noor Shaker Dr. Ammar Joukhadar Eng. Mohammad Shaker
Designed, Implemented and Tested by
Mohammed Saed Haj Ali Marah Halawa Kinda Tarboush
F.I.T.E of Damascus, Syria – AI Department 2014
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
“Why using a
stylus when God
gave us ten
fingers!”
Steve Jobs when introducing
the first iPhone, 2010
Good design looks great, yes,
Good design looks great, yes,
but
smell great and sound great?
Good design looks great, yes,
but
why shouldn't it also feel great,
smell great and sound great?
Good design looks great, yes,
but
why shouldn't it also feel great,
Jinsop Lee
“Design for all 5 senses”
The Concept of
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
The player mostly has only one method to interact with the
game (most games has the same playing peripherals) like
joystick or mouse
Most games don’t let the player to create their own
content worlds and share it with others.
For most games there’s no direct interaction between the game
and the player (only one way from the player to the game)
For most games there’s no direct interaction between the game
and the player (only one way from the player to the game)
A Game For You to Use
Your Senses
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
Sketching a Level
Sketch Your Level
Using Kinect
Interaction with the environment
Hand Gesture
Interaction with the environment
Voice Command
Our Game
Put here a picture or a short video of the
game. Just so that people know what are
you talking about
The Immersion Process
Player
Sketch
Generating
basic Level
Canvas
Allow Edit and
Generation of
Content
The Immersion Process
Player
Sketch
Generating
basic Level
Canvas
Allow Edit and
Generation of
Content
Hand Gesture
Interaction with
Dynamic
Hand Gesture
Interaction with
Static
Hand Gesture
Dynamic Hand Gesture
• Animated gestures
Static Hand Gesture
• Comparison with reference images
• Using machine learning
• Rule based system
Select
Rotate
Delete
Move
The gestures
that we will use
Hand gesture in our application
Dynamic
Hand Gesture
Static
Hand Gesture
Hand gesture in our application
Dynamic Hand Gesture
Discrete Markov
Processes
Static Hand Gesture
Rule based
system
Hand gesture in our application
Interaction via Voice Commands
Voice Command
• Audio to text conversion
Voice Command
• Speech Recognition
 Hidden Markov Model
Voice Command
• Words Meaning
 Conceptual Grammar
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
Our Application
Generate 3D environment and edit it using most of your senses!
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
Future Perspective
• Enhance the social aspect of the game
• Multiple player playing at the same time at the same
level
• Assess the game immersions metrics
• Allow for more immersive and enhanced gestures
• Analyze the applicability of the approach on other
hardware (like Oculus Rift)
• Analyze the applicability of the approach on other game
genres
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
Thanx for listening!

Más contenido relacionado

La actualidad más candente

Alex Schauer Resume
Alex Schauer ResumeAlex Schauer Resume
Alex Schauer Resume
Alex Schauer
 
The Unexpected Joys and Sorrows of Translating In-person Experiences to On-Li...
The Unexpected Joys and Sorrows of Translating In-person Experiences to On-Li...The Unexpected Joys and Sorrows of Translating In-person Experiences to On-Li...
The Unexpected Joys and Sorrows of Translating In-person Experiences to On-Li...
BayCHI
 
Remote Communication App Design - Ver. 1
Remote Communication App Design - Ver. 1Remote Communication App Design - Ver. 1
Remote Communication App Design - Ver. 1
Yuan Chen
 
UX Design: Connecting People to Information
UX Design: Connecting People to InformationUX Design: Connecting People to Information
UX Design: Connecting People to Information
Cate Kompare
 
Patrick Curry Meet Up
Patrick Curry Meet UpPatrick Curry Meet Up
Patrick Curry Meet Up
Tsugi
 

La actualidad más candente (13)

Design, Do You Speak It
Design, Do You Speak ItDesign, Do You Speak It
Design, Do You Speak It
 
Alex Schauer Resume
Alex Schauer ResumeAlex Schauer Resume
Alex Schauer Resume
 
Complexinterfaces
ComplexinterfacesComplexinterfaces
Complexinterfaces
 
Translating In-Person Experiences to Online Tools
Translating In-Person Experiences to Online ToolsTranslating In-Person Experiences to Online Tools
Translating In-Person Experiences to Online Tools
 
The Unexpected Joys and Sorrows of Translating In-person Experiences to On-Li...
The Unexpected Joys and Sorrows of Translating In-person Experiences to On-Li...The Unexpected Joys and Sorrows of Translating In-person Experiences to On-Li...
The Unexpected Joys and Sorrows of Translating In-person Experiences to On-Li...
 
Remote Communication App Design - Ver. 1
Remote Communication App Design - Ver. 1Remote Communication App Design - Ver. 1
Remote Communication App Design - Ver. 1
 
PlayScience: Media as a prompt for play
PlayScience: Media as a prompt for playPlayScience: Media as a prompt for play
PlayScience: Media as a prompt for play
 
Interaction Design - A Heady Mix of Things
Interaction Design - A Heady Mix of ThingsInteraction Design - A Heady Mix of Things
Interaction Design - A Heady Mix of Things
 
Serious game to develop and assess teamwork competency
Serious game to develop and assess teamwork competencySerious game to develop and assess teamwork competency
Serious game to develop and assess teamwork competency
 
Organizational Parkour for Seattle Infocamp, 10/2013
Organizational Parkour for Seattle Infocamp, 10/2013Organizational Parkour for Seattle Infocamp, 10/2013
Organizational Parkour for Seattle Infocamp, 10/2013
 
UX Design: Connecting People to Information
UX Design: Connecting People to InformationUX Design: Connecting People to Information
UX Design: Connecting People to Information
 
The Secret Decoder Ring: Translating Client-Speak Into Drupal Requirements
The Secret Decoder Ring: Translating Client-Speak Into Drupal RequirementsThe Secret Decoder Ring: Translating Client-Speak Into Drupal Requirements
The Secret Decoder Ring: Translating Client-Speak Into Drupal Requirements
 
Patrick Curry Meet Up
Patrick Curry Meet UpPatrick Curry Meet Up
Patrick Curry Meet Up
 

Destacado

XNA L10–Shaders Part 1
XNA L10–Shaders Part 1XNA L10–Shaders Part 1
XNA L10–Shaders Part 1
Mohammad Shaker
 
XNA L11–Shaders Part 2
XNA L11–Shaders Part 2XNA L11–Shaders Part 2
XNA L11–Shaders Part 2
Mohammad Shaker
 
WPF L03-3D Rendering and 3D Animation
WPF L03-3D Rendering and 3D AnimationWPF L03-3D Rendering and 3D Animation
WPF L03-3D Rendering and 3D Animation
Mohammad Shaker
 
WPF L01-Layouts, Controls, Styles and Templates
WPF L01-Layouts, Controls, Styles and TemplatesWPF L01-Layouts, Controls, Styles and Templates
WPF L01-Layouts, Controls, Styles and Templates
Mohammad Shaker
 
XNA L02–Basic Matrices and Transformations
XNA L02–Basic Matrices and TransformationsXNA L02–Basic Matrices and Transformations
XNA L02–Basic Matrices and Transformations
Mohammad Shaker
 

Destacado (18)

XNA L10–Shaders Part 1
XNA L10–Shaders Part 1XNA L10–Shaders Part 1
XNA L10–Shaders Part 1
 
Delphi L02 Controls P1
Delphi L02 Controls P1Delphi L02 Controls P1
Delphi L02 Controls P1
 
Indie Series 03: Becoming an Indie
Indie Series 03: Becoming an IndieIndie Series 03: Becoming an Indie
Indie Series 03: Becoming an Indie
 
C# Advanced L09-HTML5+ASP
C# Advanced L09-HTML5+ASPC# Advanced L09-HTML5+ASP
C# Advanced L09-HTML5+ASP
 
XNA L11–Shaders Part 2
XNA L11–Shaders Part 2XNA L11–Shaders Part 2
XNA L11–Shaders Part 2
 
C# Starter L07-Objects Cloning
C# Starter L07-Objects CloningC# Starter L07-Objects Cloning
C# Starter L07-Objects Cloning
 
WPF L03-3D Rendering and 3D Animation
WPF L03-3D Rendering and 3D AnimationWPF L03-3D Rendering and 3D Animation
WPF L03-3D Rendering and 3D Animation
 
Android L01 - Warm Up
Android L01 - Warm UpAndroid L01 - Warm Up
Android L01 - Warm Up
 
C# Advanced L10-Workflow Foundation
C# Advanced L10-Workflow FoundationC# Advanced L10-Workflow Foundation
C# Advanced L10-Workflow Foundation
 
WPF L01-Layouts, Controls, Styles and Templates
WPF L01-Layouts, Controls, Styles and TemplatesWPF L01-Layouts, Controls, Styles and Templates
WPF L01-Layouts, Controls, Styles and Templates
 
Interaction Design L06 - Tricks with Psychology
Interaction Design L06 - Tricks with PsychologyInteraction Design L06 - Tricks with Psychology
Interaction Design L06 - Tricks with Psychology
 
C# Advanced L08-Networking+WCF
C# Advanced L08-Networking+WCFC# Advanced L08-Networking+WCF
C# Advanced L08-Networking+WCF
 
Short, Matters, Love - Passioneers Event 2015
Short, Matters, Love -  Passioneers Event 2015Short, Matters, Love -  Passioneers Event 2015
Short, Matters, Love - Passioneers Event 2015
 
C# Starter L06-Delegates, Event Handling and Extension Methods
C# Starter L06-Delegates, Event Handling and Extension MethodsC# Starter L06-Delegates, Event Handling and Extension Methods
C# Starter L06-Delegates, Event Handling and Extension Methods
 
Car Dynamics with ABS, ESP and GPS Systems
Car Dynamics with ABS, ESP and GPS SystemsCar Dynamics with ABS, ESP and GPS Systems
Car Dynamics with ABS, ESP and GPS Systems
 
OpenGL Starter L02
OpenGL Starter L02OpenGL Starter L02
OpenGL Starter L02
 
XNA L02–Basic Matrices and Transformations
XNA L02–Basic Matrices and TransformationsXNA L02–Basic Matrices and Transformations
XNA L02–Basic Matrices and Transformations
 
Ultra Fast, Cross Genre, Procedural Content Generation in Games [Master Thesis]
Ultra Fast, Cross Genre, Procedural Content Generation in Games [Master Thesis]Ultra Fast, Cross Genre, Procedural Content Generation in Games [Master Thesis]
Ultra Fast, Cross Genre, Procedural Content Generation in Games [Master Thesis]
 

Similar a Utilizing Kinect Control for a More Immersive Interaction with 3D Environment

Webinar - Elearning: Where do serious games make most sense?
Webinar - Elearning: Where do serious games make most sense?Webinar - Elearning: Where do serious games make most sense?
Webinar - Elearning: Where do serious games make most sense?
Raptivity
 

Similar a Utilizing Kinect Control for a More Immersive Interaction with 3D Environment (20)

Utilizingkinect
UtilizingkinectUtilizingkinect
Utilizingkinect
 
Webinar - Elearning: Where do serious games make most sense?
Webinar - Elearning: Where do serious games make most sense?Webinar - Elearning: Where do serious games make most sense?
Webinar - Elearning: Where do serious games make most sense?
 
The Use of Modern Controller Devices at Schools: Game-Based Learning with the...
The Use of Modern Controller Devices at Schools: Game-Based Learning with the...The Use of Modern Controller Devices at Schools: Game-Based Learning with the...
The Use of Modern Controller Devices at Schools: Game-Based Learning with the...
 
Puzzle Game Development
Puzzle Game DevelopmentPuzzle Game Development
Puzzle Game Development
 
Ml in games intel game developer presentation v1.2
Ml in games intel game developer presentation v1.2Ml in games intel game developer presentation v1.2
Ml in games intel game developer presentation v1.2
 
Social Games Design Workshop
Social Games Design WorkshopSocial Games Design Workshop
Social Games Design Workshop
 
Literacy In Motion
Literacy In MotionLiteracy In Motion
Literacy In Motion
 
The future of User Interface
The future of User InterfaceThe future of User Interface
The future of User Interface
 
Looking at Machine Learning in Games
Looking at Machine Learning in GamesLooking at Machine Learning in Games
Looking at Machine Learning in Games
 
Android Fish Game Development
Android Fish Game Development Android Fish Game Development
Android Fish Game Development
 
From Korea to Abroad: A Developer's Lessons Learned in Global Direct Service ...
From Korea to Abroad: A Developer's Lessons Learned in Global Direct Service ...From Korea to Abroad: A Developer's Lessons Learned in Global Direct Service ...
From Korea to Abroad: A Developer's Lessons Learned in Global Direct Service ...
 
Large Scale Data Management
Large Scale Data ManagementLarge Scale Data Management
Large Scale Data Management
 
Long Lin at AI Frontiers : AI in Gaming
Long Lin at AI Frontiers : AI in GamingLong Lin at AI Frontiers : AI in Gaming
Long Lin at AI Frontiers : AI in Gaming
 
Sutd Game Lab's prototyping tips
Sutd Game Lab's prototyping tipsSutd Game Lab's prototyping tips
Sutd Game Lab's prototyping tips
 
AI in the Cloud: Use of Machine Learning in Games | George Dolbier
AI in the Cloud: Use of Machine Learning in Games | George DolbierAI in the Cloud: Use of Machine Learning in Games | George Dolbier
AI in the Cloud: Use of Machine Learning in Games | George Dolbier
 
Case studies in Games, Machine Learning in the Cloud,
Case studies in Games, Machine Learning in the Cloud,Case studies in Games, Machine Learning in the Cloud,
Case studies in Games, Machine Learning in the Cloud,
 
Neev Hackathon 2013 - Super Feet
Neev Hackathon 2013 - Super FeetNeev Hackathon 2013 - Super Feet
Neev Hackathon 2013 - Super Feet
 
VR - Creating the ultimate reality
VR - Creating the ultimate realityVR - Creating the ultimate reality
VR - Creating the ultimate reality
 
Meta 3D Studios Art Experience
Meta 3D Studios Art ExperienceMeta 3D Studios Art Experience
Meta 3D Studios Art Experience
 
Augernaut js
Augernaut jsAugernaut js
Augernaut js
 

Más de Mohammad Shaker

Más de Mohammad Shaker (20)

12 Rules You Should to Know as a Syrian Graduate
12 Rules You Should to Know as a Syrian Graduate12 Rules You Should to Know as a Syrian Graduate
12 Rules You Should to Know as a Syrian Graduate
 
Unity L01 - Game Development
Unity L01 - Game DevelopmentUnity L01 - Game Development
Unity L01 - Game Development
 
Android L07 - Touch, Screen and Wearables
Android L07 - Touch, Screen and WearablesAndroid L07 - Touch, Screen and Wearables
Android L07 - Touch, Screen and Wearables
 
Interaction Design L03 - Color
Interaction Design L03 - ColorInteraction Design L03 - Color
Interaction Design L03 - Color
 
Interaction Design L05 - Typography
Interaction Design L05 - TypographyInteraction Design L05 - Typography
Interaction Design L05 - Typography
 
Interaction Design L04 - Materialise and Coupling
Interaction Design L04 - Materialise and CouplingInteraction Design L04 - Materialise and Coupling
Interaction Design L04 - Materialise and Coupling
 
Android L05 - Storage
Android L05 - StorageAndroid L05 - Storage
Android L05 - Storage
 
Android L04 - Notifications and Threading
Android L04 - Notifications and ThreadingAndroid L04 - Notifications and Threading
Android L04 - Notifications and Threading
 
Android L09 - Windows Phone and iOS
Android L09 - Windows Phone and iOSAndroid L09 - Windows Phone and iOS
Android L09 - Windows Phone and iOS
 
Interaction Design L01 - Mobile Constraints
Interaction Design L01 - Mobile ConstraintsInteraction Design L01 - Mobile Constraints
Interaction Design L01 - Mobile Constraints
 
Interaction Design L02 - Pragnanz and Grids
Interaction Design L02 - Pragnanz and GridsInteraction Design L02 - Pragnanz and Grids
Interaction Design L02 - Pragnanz and Grids
 
Android L10 - Stores and Gaming
Android L10 - Stores and GamingAndroid L10 - Stores and Gaming
Android L10 - Stores and Gaming
 
Android L06 - Cloud / Parse
Android L06 - Cloud / ParseAndroid L06 - Cloud / Parse
Android L06 - Cloud / Parse
 
Android L08 - Google Maps and Utilities
Android L08 - Google Maps and UtilitiesAndroid L08 - Google Maps and Utilities
Android L08 - Google Maps and Utilities
 
Android L03 - Styles and Themes
Android L03 - Styles and Themes Android L03 - Styles and Themes
Android L03 - Styles and Themes
 
Android L02 - Activities and Adapters
Android L02 - Activities and AdaptersAndroid L02 - Activities and Adapters
Android L02 - Activities and Adapters
 
Indie Series 01: Intro to Games
Indie Series 01: Intro to GamesIndie Series 01: Intro to Games
Indie Series 01: Intro to Games
 
Indie Series 04: The Making of SyncSeven
Indie Series 04: The Making of SyncSevenIndie Series 04: The Making of SyncSeven
Indie Series 04: The Making of SyncSeven
 
Indie Series 02: AI and Recent Advances in Games
Indie Series 02: AI and Recent Advances in GamesIndie Series 02: AI and Recent Advances in Games
Indie Series 02: AI and Recent Advances in Games
 
Roboconf DSL Advanced Software Engineering
Roboconf DSL Advanced Software EngineeringRoboconf DSL Advanced Software Engineering
Roboconf DSL Advanced Software Engineering
 

Último

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Último (20)

AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 

Utilizing Kinect Control for a More Immersive Interaction with 3D Environment

  • 1. Utilizing Kinect Control for a More Immersive Interaction with 3D Environments Supervised by Dr. Noor Shaker Dr. Ammar Joukhadar Eng. Mohammad Shaker Designed, Implemented and Tested by Mohammed Saed Haj Ali Marah Halawa Kinda Tarboush F.I.T.E of Damascus, Syria – AI Department 2014
  • 2. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  • 3. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  • 4. “Why using a stylus when God gave us ten fingers!” Steve Jobs when introducing the first iPhone, 2010
  • 5.
  • 6. Good design looks great, yes,
  • 7. Good design looks great, yes, but
  • 8. smell great and sound great? Good design looks great, yes, but why shouldn't it also feel great,
  • 9. smell great and sound great? Good design looks great, yes, but why shouldn't it also feel great,
  • 10. Jinsop Lee “Design for all 5 senses” The Concept of
  • 11. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  • 12. The player mostly has only one method to interact with the game (most games has the same playing peripherals) like joystick or mouse
  • 13. Most games don’t let the player to create their own content worlds and share it with others.
  • 14. For most games there’s no direct interaction between the game and the player (only one way from the player to the game)
  • 15. For most games there’s no direct interaction between the game and the player (only one way from the player to the game)
  • 16. A Game For You to Use Your Senses
  • 17. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  • 20. Interaction with the environment Hand Gesture
  • 21. Interaction with the environment Voice Command
  • 22. Our Game Put here a picture or a short video of the game. Just so that people know what are you talking about
  • 23. The Immersion Process Player Sketch Generating basic Level Canvas Allow Edit and Generation of Content
  • 24. The Immersion Process Player Sketch Generating basic Level Canvas Allow Edit and Generation of Content
  • 25. Hand Gesture Interaction with Dynamic Hand Gesture Interaction with Static Hand Gesture
  • 26. Dynamic Hand Gesture • Animated gestures
  • 27. Static Hand Gesture • Comparison with reference images • Using machine learning • Rule based system
  • 29. Hand gesture in our application Dynamic Hand Gesture Static Hand Gesture
  • 30. Hand gesture in our application Dynamic Hand Gesture Discrete Markov Processes Static Hand Gesture Rule based system
  • 31. Hand gesture in our application
  • 33. Voice Command • Audio to text conversion
  • 34. Voice Command • Speech Recognition  Hidden Markov Model
  • 35. Voice Command • Words Meaning  Conceptual Grammar
  • 36. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  • 37. Our Application Generate 3D environment and edit it using most of your senses!
  • 38. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  • 39. Future Perspective • Enhance the social aspect of the game • Multiple player playing at the same time at the same level • Assess the game immersions metrics • Allow for more immersive and enhanced gestures • Analyze the applicability of the approach on other hardware (like Oculus Rift) • Analyze the applicability of the approach on other game genres
  • 40. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo