SlideShare una empresa de Scribd logo
1 de 26
Integration of computer vision and RTL technologies for ambient intelligence and Human-Computer Interaction Massimiliano Dibitonto  DRIEI Dottorato di Ricerca in Ingegneria Elettronica e Informatica University of Cagliari, Italy
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Wireless Real Time Locating Systems ,[object Object],[object Object],[object Object],[object Object],[object Object]
Wireless Real Time Locating Systems ,[object Object],[object Object],[object Object],UWB ACTIVE RFID  1cm 1cm 10 cm 1 m 10 m Outdoor Semi urban Urban Building Room Objects GPS  Wi-Fi Passive RFID  accuracy ZigBee
Computer Vision ,[object Object],[object Object],[object Object],[object Object]
CV and RTLS “complementarity” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Both systems try to aswer to two  MAIN  common questions:  Who/What  and  Where The main differences are
CV and RTLS “complementarity” ,[object Object],RTLS CV 2d – 3d position temperature, humidity, pressure, acceleration, etc.. unique  ID Orientation, gestures , biometrics, fine grained movements, recognition of different features Other sensors  onboard: Fusion models can be developed to harvest the information gained from the two systems
CV and RTL/RFID fusion ,[object Object],[object Object],[object Object],[object Object]
CV and RTL/RFID fusion: objects/people recognition ,[object Object],[object Object],*Cerrada, C.; Salamanca, S.; Perez, E.; Cerrada, J.A.; Abad, I., "Fusion of 3D Vision Techniques and RFID Technology for Object Recognition in Complex Scenes,"  Intelligent Signal Processing, 2007. WISP 2007. IEEE International Symposium on  , vol., no., pp.1-6, 3-5 Oct. 2007
CV and RTL fusion: Localization ,[object Object],[object Object],[object Object],[object Object],CV RTLS ,[object Object]
CV and RTL/RFID fusion:  Behaviour analysis ,[object Object],[object Object],* Krahnstoever, N.; Rittscher, J.; Tu, P.; Chean, K.; Tomlinson, T., "Activity Recognition using Visual Tracking and RFID,"  Application of Computer Vision, 2005. WACV/MOTIONS '05 Volume 1. Seventh IEEE Workshops on  , vol.1, no., pp.494-500, 5-7 Jan. 2005 Frame Grabber Articulated Tracker RFID Reader Custom Pose Estimation Circuitery Activity recognition
Objectives Outline Our research will point  to:
Objectives: integration models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Proposed integration models Sequential model :  the RTL system act as a guide fro the vision based tracking system. The main benefit  is a reduction of the computational complexity but on the other hand it doesn’t detect people/object not equipped with a tag.
Proposed integration models Parallel model :  the  two systems works indipendently , then a data fusion system analyze the two outputs . Localization via RTL/RFID system Image analysis – object/person tracking  Comparison  of the obtained data
Proposed integration models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Objectives: performance evaluation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Objectives: new HCI paradigms ,[object Object],[object Object],[object Object],[object Object],Interface adaptation module Multi agent system Context capture system RTLS Wireless Sensors and Actuators Network Computer Vision System
Objectives: usability evaluation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Possible Scenarios – Ambient Intelligence ,[object Object],[object Object],0100011100101000....
PhD Thesis Starting Point: A prototype of CV and RTL fusion at DIEE ,[object Object],[object Object],RTL and RFID services Video module Segnalation module
PhD Thesis Starting Point: A prototype of CV and RTL fusion at DIEE ,[object Object],[object Object]
Progress beyond SoA ,[object Object],[object Object],[object Object],[object Object],[object Object]
Put together different “worlds”..... ... toward new intelligent scenarios
[object Object],Department of Electrical and Electronic Engineering (PRA group) of University of Cagliari with its strong competence on Computer Vision Cattid fron Sapienza University for his competence on Human Computer Interaction and Real Time Locating Systems
[object Object],[object Object]

Más contenido relacionado

Destacado

Destacado (14)

Faccio Parte Parole In Comune Presentazione
Faccio Parte Parole In Comune PresentazioneFaccio Parte Parole In Comune Presentazione
Faccio Parte Parole In Comune Presentazione
 
Usability of Digital Radio
Usability of Digital RadioUsability of Digital Radio
Usability of Digital Radio
 
My Italy:Design and usability evaluation of an M-Tourism prototype
My Italy:Design and usability evaluation of an M-Tourism prototypeMy Italy:Design and usability evaluation of an M-Tourism prototype
My Italy:Design and usability evaluation of an M-Tourism prototype
 
My Personal Hero
My Personal HeroMy Personal Hero
My Personal Hero
 
DESAFÍOS DEL PENSAMIENTO CRITICO
DESAFÍOS DEL PENSAMIENTO CRITICODESAFÍOS DEL PENSAMIENTO CRITICO
DESAFÍOS DEL PENSAMIENTO CRITICO
 
You Can Do More Than You Think
You Can Do More Than You ThinkYou Can Do More Than You Think
You Can Do More Than You Think
 
Designing the Internet of Things
Designing the Internet of ThingsDesigning the Internet of Things
Designing the Internet of Things
 
Lessons from Game Design
Lessons from Game DesignLessons from Game Design
Lessons from Game Design
 
Localization Issues in a ZigBee based Internet of Things scenario
Localization Issues in a ZigBee based Internet of Things scenarioLocalization Issues in a ZigBee based Internet of Things scenario
Localization Issues in a ZigBee based Internet of Things scenario
 
Designing for Internet of Things is shaping relationships
Designing  for Internet of Things is shaping relationshipsDesigning  for Internet of Things is shaping relationships
Designing for Internet of Things is shaping relationships
 
From Watching to Making: the democratization of knowledge and invention
From Watching to Making: the democratization of knowledge and inventionFrom Watching to Making: the democratization of knowledge and invention
From Watching to Making: the democratization of knowledge and invention
 
VR and the Future of Education
VR and the Future of EducationVR and the Future of Education
VR and the Future of Education
 
VR and AR: 2016, 2020, and 2025
VR and AR: 2016, 2020, and 2025VR and AR: 2016, 2020, and 2025
VR and AR: 2016, 2020, and 2025
 
IoT Design Deck
IoT Design DeckIoT Design Deck
IoT Design Deck
 

Similar a Phd Thesis Project

Semantic Sensor Service Networks
Semantic Sensor Service NetworksSemantic Sensor Service Networks
Semantic Sensor Service Networks
PayamBarnaghi
 
Traffic Sign Detection and Recognition for Automated Driverless Cars Based on...
Traffic Sign Detection and Recognition for Automated Driverless Cars Based on...Traffic Sign Detection and Recognition for Automated Driverless Cars Based on...
Traffic Sign Detection and Recognition for Automated Driverless Cars Based on...
ijtsrd
 
Hand Motion Gestures For Mobile Communication Based On Inertial Sensors For O...
Hand Motion Gestures For Mobile Communication Based On Inertial Sensors For O...Hand Motion Gestures For Mobile Communication Based On Inertial Sensors For O...
Hand Motion Gestures For Mobile Communication Based On Inertial Sensors For O...
IJERA Editor
 

Similar a Phd Thesis Project (20)

Semantic IoT Semantic Inter-Operability Practices - Part 2
Semantic IoT Semantic Inter-Operability Practices - Part 2Semantic IoT Semantic Inter-Operability Practices - Part 2
Semantic IoT Semantic Inter-Operability Practices - Part 2
 
Enhancing indoor localization using IoT techniques
Enhancing indoor localization using IoT techniquesEnhancing indoor localization using IoT techniques
Enhancing indoor localization using IoT techniques
 
Semantic Sensor Service Networks
Semantic Sensor Service NetworksSemantic Sensor Service Networks
Semantic Sensor Service Networks
 
Dynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT EnvironmentsDynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT Environments
 
DESIGN AND VLSIIMPLEMENTATION OF ANTICOLLISION ENABLED ROBOT PROCESSOR USING ...
DESIGN AND VLSIIMPLEMENTATION OF ANTICOLLISION ENABLED ROBOT PROCESSOR USING ...DESIGN AND VLSIIMPLEMENTATION OF ANTICOLLISION ENABLED ROBOT PROCESSOR USING ...
DESIGN AND VLSIIMPLEMENTATION OF ANTICOLLISION ENABLED ROBOT PROCESSOR USING ...
 
IoT-Lite: A Lightweight Semantic Model for the Internet of Things
IoT-Lite:  A Lightweight Semantic Model for the Internet of ThingsIoT-Lite:  A Lightweight Semantic Model for the Internet of Things
IoT-Lite: A Lightweight Semantic Model for the Internet of Things
 
Io t research_arpanpal_iem
Io t research_arpanpal_iemIo t research_arpanpal_iem
Io t research_arpanpal_iem
 
AF-2599-P.docx
AF-2599-P.docxAF-2599-P.docx
AF-2599-P.docx
 
Traffic Sign Detection and Recognition for Automated Driverless Cars Based on...
Traffic Sign Detection and Recognition for Automated Driverless Cars Based on...Traffic Sign Detection and Recognition for Automated Driverless Cars Based on...
Traffic Sign Detection and Recognition for Automated Driverless Cars Based on...
 
abstract.pdf
abstract.pdfabstract.pdf
abstract.pdf
 
abstract.docx
abstract.docxabstract.docx
abstract.docx
 
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...
Nuzzer algorithm based Human Tracking and Security System for Device-Free Pas...
 
chapter 4.pdf
chapter 4.pdfchapter 4.pdf
chapter 4.pdf
 
chapter 4.docx
chapter 4.docxchapter 4.docx
chapter 4.docx
 
u world 2012, Dalian, China
u world 2012, Dalian, China u world 2012, Dalian, China
u world 2012, Dalian, China
 
Hand Motion Gestures For Mobile Communication Based On Inertial Sensors For O...
Hand Motion Gestures For Mobile Communication Based On Inertial Sensors For O...Hand Motion Gestures For Mobile Communication Based On Inertial Sensors For O...
Hand Motion Gestures For Mobile Communication Based On Inertial Sensors For O...
 
20130503 iCore at calipso workshop fia dublin
20130503 iCore at calipso workshop fia dublin20130503 iCore at calipso workshop fia dublin
20130503 iCore at calipso workshop fia dublin
 
CRIMINAL IDENTIFICATION FOR LOW RESOLUTION SURVEILLANCE
CRIMINAL IDENTIFICATION FOR LOW RESOLUTION SURVEILLANCECRIMINAL IDENTIFICATION FOR LOW RESOLUTION SURVEILLANCE
CRIMINAL IDENTIFICATION FOR LOW RESOLUTION SURVEILLANCE
 
iotarchitecture-190506052723.pdf
iotarchitecture-190506052723.pdfiotarchitecture-190506052723.pdf
iotarchitecture-190506052723.pdf
 
Iot architecture
Iot architectureIot architecture
Iot architecture
 

Último

Mckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for ViewingMckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for Viewing
Nauman Safdar
 
Jual Obat Aborsi ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan Cytotec
Jual Obat Aborsi ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan CytotecJual Obat Aborsi ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan Cytotec
Jual Obat Aborsi ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan Cytotec
ZurliaSoop
 
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in OmanMifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
instagramfab782445
 

Último (20)

Paradip CALL GIRL❤7091819311❤CALL GIRLS IN ESCORT SERVICE WE ARE PROVIDING
Paradip CALL GIRL❤7091819311❤CALL GIRLS IN ESCORT SERVICE WE ARE PROVIDINGParadip CALL GIRL❤7091819311❤CALL GIRLS IN ESCORT SERVICE WE ARE PROVIDING
Paradip CALL GIRL❤7091819311❤CALL GIRLS IN ESCORT SERVICE WE ARE PROVIDING
 
PHX May 2024 Corporate Presentation Final
PHX May 2024 Corporate Presentation FinalPHX May 2024 Corporate Presentation Final
PHX May 2024 Corporate Presentation Final
 
Mckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for ViewingMckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for Viewing
 
Organizational Transformation Lead with Culture
Organizational Transformation Lead with CultureOrganizational Transformation Lead with Culture
Organizational Transformation Lead with Culture
 
Falcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to ProsperityFalcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to Prosperity
 
Falcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investorsFalcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investors
 
How to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League CityHow to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League City
 
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...
 
Falcon Invoice Discounting: Empowering Your Business Growth
Falcon Invoice Discounting: Empowering Your Business GrowthFalcon Invoice Discounting: Empowering Your Business Growth
Falcon Invoice Discounting: Empowering Your Business Growth
 
Falcon Invoice Discounting: Aviate Your Cash Flow Challenges
Falcon Invoice Discounting: Aviate Your Cash Flow ChallengesFalcon Invoice Discounting: Aviate Your Cash Flow Challenges
Falcon Invoice Discounting: Aviate Your Cash Flow Challenges
 
Over the Top (OTT) Market Size & Growth Outlook 2024-2030
Over the Top (OTT) Market Size & Growth Outlook 2024-2030Over the Top (OTT) Market Size & Growth Outlook 2024-2030
Over the Top (OTT) Market Size & Growth Outlook 2024-2030
 
Putting the SPARK into Virtual Training.pptx
Putting the SPARK into Virtual Training.pptxPutting the SPARK into Virtual Training.pptx
Putting the SPARK into Virtual Training.pptx
 
SEO Case Study: How I Increased SEO Traffic & Ranking by 50-60% in 6 Months
SEO Case Study: How I Increased SEO Traffic & Ranking by 50-60%  in 6 MonthsSEO Case Study: How I Increased SEO Traffic & Ranking by 50-60%  in 6 Months
SEO Case Study: How I Increased SEO Traffic & Ranking by 50-60% in 6 Months
 
Jual Obat Aborsi ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan Cytotec
Jual Obat Aborsi ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan CytotecJual Obat Aborsi ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan Cytotec
Jual Obat Aborsi ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan Cytotec
 
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
 
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in OmanMifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
 
New 2024 Cannabis Edibles Investor Pitch Deck Template
New 2024 Cannabis Edibles Investor Pitch Deck TemplateNew 2024 Cannabis Edibles Investor Pitch Deck Template
New 2024 Cannabis Edibles Investor Pitch Deck Template
 
Phases of Negotiation .pptx
 Phases of Negotiation .pptx Phases of Negotiation .pptx
Phases of Negotiation .pptx
 
Power point presentation on enterprise performance management
Power point presentation on enterprise performance managementPower point presentation on enterprise performance management
Power point presentation on enterprise performance management
 
Falcon Invoice Discounting: Tailored Financial Wings
Falcon Invoice Discounting: Tailored Financial WingsFalcon Invoice Discounting: Tailored Financial Wings
Falcon Invoice Discounting: Tailored Financial Wings
 

Phd Thesis Project

  • 1. Integration of computer vision and RTL technologies for ambient intelligence and Human-Computer Interaction Massimiliano Dibitonto DRIEI Dottorato di Ricerca in Ingegneria Elettronica e Informatica University of Cagliari, Italy
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12. Objectives Outline Our research will point to:
  • 13.
  • 14. Proposed integration models Sequential model : the RTL system act as a guide fro the vision based tracking system. The main benefit is a reduction of the computational complexity but on the other hand it doesn’t detect people/object not equipped with a tag.
  • 15. Proposed integration models Parallel model : the two systems works indipendently , then a data fusion system analyze the two outputs . Localization via RTL/RFID system Image analysis – object/person tracking Comparison of the obtained data
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24. Put together different “worlds”..... ... toward new intelligent scenarios
  • 25.
  • 26.

Notas del editor

  1. Cooperative and non cooperative
  2. We are moving toward an Internet of Things scenario where objects and spaces are becoming “ intelligent ” and rich of information . This scenario is rising new challenges and new opportunities especially in the field of Human Computer Interaction . HCI paradigms are evolving toward “fluid” interfaces that become part of the surrounding environment and that are able to react to human behaviours and that should provide a natural interaction while interacting with complex systems, and avoid cognitive overload while accessing information and services Fusion of this different systems can be used to rethink the human-machine interactive experience developing new kind of interfaces. Integration models can be designed to use this systems as input device itself (i.e. proximity, gesture recognition) or use their outputs in more complex context capture systems and in multi agent systems to realize ambient that are “intelligent” allowing new kind of interaction paradigms between humans and machines.
  3. As traditional approaches of usability testing are suitable for testing individual applications or devices in an isolated manner there is the need to design new evaluation methodologies for this new kind of interfaces.