SlideShare una empresa de Scribd logo
1 de 13
Descargar para leer sin conexión
Getting Started with Sensor Data for
Autonomous Cars:
Sensor Fusion Part 2
Session Four: Sensor Fusion for Vehicle Cognition
Webinar Overview
1) Sensor fusion brief intro and recap
2) Atlas Devkit video
3) Questions
4) Integrating HD Semantic Map with the Autonomous Car
Cognition for Cars
Hardware
Abstraction
Layer
(HAL)
GPS
IMU
LiDAR
Localization in
6 dimensions
3D Semantic
Mapping
Augmented Reality
Maps and Context
Civil Maps Products
Point Cloud
Civil Maps Block Diagram (1 of 2)
Radar
Camera
LiDAR
Civil Maps Prior Map
around vehicle (Context)
Civil Maps Block Diagram Part 2 of 2
Real-time
map
validation
and state
detection
Decision
Engine and
Actuation
Detailed queries
of map:
“How far until the
intersection?”
HD Semantic Map: A Sensor
Using the Map in Sensor Fusion
● Output validation
● Optimize resource usage with foveation
● State detection (signal light red, yellow, green)
HD Semantic Map: A Map
Route Planning
● Lane by lane instructions between waypoints
● Alternative routes in case of unpredicted event
● ‘Near clipping distance’ semantic map refreshed at desired frequency
Driveable Area and Speed Control
HD Semantic Map: A Map
● Recommended drivable area from
aggregated observable path
● Real time feedback on vehicle
position within the drivable area
(Safe->Warning->Emergency)
● Drivable path and routing direction for
Steering control
● Essential Map data for Speed Control
○ Speed limit
○ Cross slope
○ Lane width
○ Distance to event trigger
○ Aggregated trip statistics
Questions & Comments
● Webinar videos & documentation
○ YouTube Playlist
○ Slides
○ GitHub code
Coming Soon:
After Webinar - Happy Hour San Francisco, CA
111 Minna Gallery, San Francisco, CA
Today, 6/29 at 6:00 PM PST
The Future of Transportation World Conference, Cologne, Germany
Ensuring Safety & Building Trust in an Autonomous World
Sravan Puttagunta (Co-founder) - July 5 - 6
Autonomy - The Urban Mobility Summit, Paris, France
October 19 - 21
Upcoming Events:
Twitter: https://twitter.com/CivilMaps
Facebook: https://www.facebook.com/civilmaps
Linkedin: https://www.linkedin.com/company/civil-maps
YouTube: https://www.youtube.com/channel/UC2nJduOZeF0KAZVDOpyX_lA
Medium Blog: https://medium.com/@CivilMaps
AngelList: https://angel.co/civil-maps
Follow us on Social Media:
Thank You!

Más contenido relacionado

Destacado (20)

Open-World Mission Specification for Reactive Robots - ICRA 2014
Open-World Mission Specification for Reactive Robots - ICRA 2014Open-World Mission Specification for Reactive Robots - ICRA 2014
Open-World Mission Specification for Reactive Robots - ICRA 2014
 
Transducer signal conditioners
Transducer signal conditionersTransducer signal conditioners
Transducer signal conditioners
 
Difference between Sensor & Transducer
Difference between Sensor & TransducerDifference between Sensor & Transducer
Difference between Sensor & Transducer
 
Transducers
TransducersTransducers
Transducers
 
Transducer main
Transducer mainTransducer main
Transducer main
 
August 29, Overview over Systems studied in the course
August 29, Overview over Systems studied in the courseAugust 29, Overview over Systems studied in the course
August 29, Overview over Systems studied in the course
 
Unit 1(part-2)sensors and transducer
Unit 1(part-2)sensors and transducerUnit 1(part-2)sensors and transducer
Unit 1(part-2)sensors and transducer
 
Wb4-1
Wb4-1Wb4-1
Wb4-1
 
Building Robots Tutorial
Building Robots TutorialBuilding Robots Tutorial
Building Robots Tutorial
 
Ajm unit 2
Ajm unit 2Ajm unit 2
Ajm unit 2
 
August 31, Reactive Algorithms I
August 31, Reactive Algorithms IAugust 31, Reactive Algorithms I
August 31, Reactive Algorithms I
 
Application of image processing
Application of image processingApplication of image processing
Application of image processing
 
Ai class
Ai classAi class
Ai class
 
Transducer
TransducerTransducer
Transducer
 
Sensors update
Sensors updateSensors update
Sensors update
 
Parallel sorting
Parallel sortingParallel sorting
Parallel sorting
 
Introduction to robotics
Introduction to roboticsIntroduction to robotics
Introduction to robotics
 
Parallel sorting Algorithms
Parallel  sorting AlgorithmsParallel  sorting Algorithms
Parallel sorting Algorithms
 
Passive infrared based human detection alive robot
Passive infrared based human detection alive robotPassive infrared based human detection alive robot
Passive infrared based human detection alive robot
 
sensors in robotics
sensors in roboticssensors in robotics
sensors in robotics
 

Último

248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdfkushkruthik555
 
A Comprehensive Exploration of the Components and Parts Found in Diesel Engines
A Comprehensive Exploration of the Components and Parts Found in Diesel EnginesA Comprehensive Exploration of the Components and Parts Found in Diesel Engines
A Comprehensive Exploration of the Components and Parts Found in Diesel EnginesROJANE BERNAS, PhD.
 
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILESABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILESsriharshaganjam1
 
Building a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
Building a Future Where Everyone Can Ride and Drive Electric by Bridget GilmoreBuilding a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
Building a Future Where Everyone Can Ride and Drive Electric by Bridget GilmoreForth
 
-The-Present-Simple-Tense.pdf english hh
-The-Present-Simple-Tense.pdf english hh-The-Present-Simple-Tense.pdf english hh
-The-Present-Simple-Tense.pdf english hhmhamadhawlery16
 
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!Mint Automotive
 
Mastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
Mastering Mercedes Engine Care Top Tips for Rowlett, TX ResidentsMastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
Mastering Mercedes Engine Care Top Tips for Rowlett, TX ResidentsRowlett Motorwerks
 
Pros and cons of buying used fleet vehicles.pptx
Pros and cons of buying used fleet vehicles.pptxPros and cons of buying used fleet vehicles.pptx
Pros and cons of buying used fleet vehicles.pptxjennifermiller8137
 
Control-Plan-Training.pptx for the Automotive standard AIAG
Control-Plan-Training.pptx for the Automotive standard AIAGControl-Plan-Training.pptx for the Automotive standard AIAG
Control-Plan-Training.pptx for the Automotive standard AIAGVikrantPawar37
 
Welcome to Auto Know University Orientation
Welcome to Auto Know University OrientationWelcome to Auto Know University Orientation
Welcome to Auto Know University Orientationxlr8sales
 
Human Resource Practices TATA MOTORS.pdf
Human Resource Practices TATA MOTORS.pdfHuman Resource Practices TATA MOTORS.pdf
Human Resource Practices TATA MOTORS.pdfAditiMishra247289
 
Lighting the Way Understanding Jaguar Car Check Engine Light Service
Lighting the Way Understanding Jaguar Car Check Engine Light ServiceLighting the Way Understanding Jaguar Car Check Engine Light Service
Lighting the Way Understanding Jaguar Car Check Engine Light ServiceImport Car Center
 

Último (12)

248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
 
A Comprehensive Exploration of the Components and Parts Found in Diesel Engines
A Comprehensive Exploration of the Components and Parts Found in Diesel EnginesA Comprehensive Exploration of the Components and Parts Found in Diesel Engines
A Comprehensive Exploration of the Components and Parts Found in Diesel Engines
 
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILESABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
 
Building a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
Building a Future Where Everyone Can Ride and Drive Electric by Bridget GilmoreBuilding a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
Building a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
 
-The-Present-Simple-Tense.pdf english hh
-The-Present-Simple-Tense.pdf english hh-The-Present-Simple-Tense.pdf english hh
-The-Present-Simple-Tense.pdf english hh
 
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
 
Mastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
Mastering Mercedes Engine Care Top Tips for Rowlett, TX ResidentsMastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
Mastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
 
Pros and cons of buying used fleet vehicles.pptx
Pros and cons of buying used fleet vehicles.pptxPros and cons of buying used fleet vehicles.pptx
Pros and cons of buying used fleet vehicles.pptx
 
Control-Plan-Training.pptx for the Automotive standard AIAG
Control-Plan-Training.pptx for the Automotive standard AIAGControl-Plan-Training.pptx for the Automotive standard AIAG
Control-Plan-Training.pptx for the Automotive standard AIAG
 
Welcome to Auto Know University Orientation
Welcome to Auto Know University OrientationWelcome to Auto Know University Orientation
Welcome to Auto Know University Orientation
 
Human Resource Practices TATA MOTORS.pdf
Human Resource Practices TATA MOTORS.pdfHuman Resource Practices TATA MOTORS.pdf
Human Resource Practices TATA MOTORS.pdf
 
Lighting the Way Understanding Jaguar Car Check Engine Light Service
Lighting the Way Understanding Jaguar Car Check Engine Light ServiceLighting the Way Understanding Jaguar Car Check Engine Light Service
Lighting the Way Understanding Jaguar Car Check Engine Light Service
 

Webinar 4 - Sensor Fusion - Part 2

  • 1. Getting Started with Sensor Data for Autonomous Cars: Sensor Fusion Part 2 Session Four: Sensor Fusion for Vehicle Cognition
  • 2. Webinar Overview 1) Sensor fusion brief intro and recap 2) Atlas Devkit video 3) Questions 4) Integrating HD Semantic Map with the Autonomous Car
  • 4. Hardware Abstraction Layer (HAL) GPS IMU LiDAR Localization in 6 dimensions 3D Semantic Mapping Augmented Reality Maps and Context Civil Maps Products Point Cloud Civil Maps Block Diagram (1 of 2)
  • 5. Radar Camera LiDAR Civil Maps Prior Map around vehicle (Context) Civil Maps Block Diagram Part 2 of 2 Real-time map validation and state detection Decision Engine and Actuation Detailed queries of map: “How far until the intersection?”
  • 6. HD Semantic Map: A Sensor Using the Map in Sensor Fusion ● Output validation ● Optimize resource usage with foveation ● State detection (signal light red, yellow, green)
  • 7. HD Semantic Map: A Map Route Planning ● Lane by lane instructions between waypoints ● Alternative routes in case of unpredicted event ● ‘Near clipping distance’ semantic map refreshed at desired frequency
  • 8. Driveable Area and Speed Control HD Semantic Map: A Map ● Recommended drivable area from aggregated observable path ● Real time feedback on vehicle position within the drivable area (Safe->Warning->Emergency) ● Drivable path and routing direction for Steering control ● Essential Map data for Speed Control ○ Speed limit ○ Cross slope ○ Lane width ○ Distance to event trigger ○ Aggregated trip statistics
  • 10. ● Webinar videos & documentation ○ YouTube Playlist ○ Slides ○ GitHub code Coming Soon:
  • 11. After Webinar - Happy Hour San Francisco, CA 111 Minna Gallery, San Francisco, CA Today, 6/29 at 6:00 PM PST The Future of Transportation World Conference, Cologne, Germany Ensuring Safety & Building Trust in an Autonomous World Sravan Puttagunta (Co-founder) - July 5 - 6 Autonomy - The Urban Mobility Summit, Paris, France October 19 - 21 Upcoming Events:
  • 12. Twitter: https://twitter.com/CivilMaps Facebook: https://www.facebook.com/civilmaps Linkedin: https://www.linkedin.com/company/civil-maps YouTube: https://www.youtube.com/channel/UC2nJduOZeF0KAZVDOpyX_lA Medium Blog: https://medium.com/@CivilMaps AngelList: https://angel.co/civil-maps Follow us on Social Media: