Building intelligent robots

Justin Hayward
Justin HaywardFounder Director, Cambridge Investment Research
www.cir-strategy.com/events 	
Alex	Kendall	
WAYVE
Building intelligent robots
Building intelligent robots
Building intelligent robots
Part	I:		Computer	Vision
1.  Infant	Vision:	Birth	to	24	Months	of	Age.	
https://www.aoa.org/patients-and-public/good-vision-throughout-life/childrens-vision/infant-vision-birth-to-24-months-of-age?
Building intelligent robots
Deep	Learning	for	Computer	Vision	
•  Powerful	framework	for	understanding	high	dimensional	data	like	
images,	videos,	speech,	text	
•  With	enough	training	data,	they	outperform	human	baselines	for	
recognition	tasks	
•  Typically	computer	vision	models	contain	~10	million	parameters,	
take	3+	days	to	train	on	a	GPU
Alex	Kendall,	Yarin	Gal	and	Roberto	Cipolla.	Multi-Task	Learning	Using	Uncertainty	to	Weigh	Losses	for	Scene	Geometry	and	
Semantics.	In	Submission,	2017.
Alex	Kendall	and	Roberto	Cipolla.	VideoSegNet:	Self-Supervised	Motion	and	Depth	for	Video	Semantic	Segmentation.		
In	Submission,	2017.
Building intelligent robots
Part	II:		Ethics	&	Safety
1.  The	Trolley	Problem,	Wikipedia.	https://en.wikipedia.org/wiki/Trolley_problem	
2.  Rowan	McAllister,	Yarin	Gal,	Alex	Kendall,	Mark	van	der	Wilk,	Amar	Shah,	Roberto	Cipolla,	and	Adrian	Weller.	Concrete	Problems	for	Autonomous	
Vehicle	Safety:	Advantages	of	Bayesian	Deep	Learning.	IJCAI,	2017.	
The	Trolley	Problem	 Do you…
1.  Do nothing, and the
trolley kills the five
people on the main
track.
2.  Pull the lever, diverting
the trolley onto the side
track where it will kill
one person.
Which is the most ethical
choice?
Examples	of	Un-Ethical	AI,	Today	
•  US	Justice	System	Re-Offending	Rate	algorithm..	Biased	against	
minorities	
https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing	
•  Google’s	speech	recognition	system	is	better	at	male	voices	
https://makingnoiseandhearingthings.com/2016/07/12/googles-speech-recognition-has-a-gender-bias/	
•  Many	self-driving	cars	only	work	in	California	
https://www.ft.com/content/4377b4c0-0479-11e7-aa5b-6bb07f5c8e12
Concrete	Problems	for	AI	Safety	
•  Trust	
•  Improve	model	performance	and	accuracy	
•  Models	understanding	uncertainty	in	decisions	
•  Fairness	
•  Improve	data	efficiency	and	reduce	bias	
•  Algorithms	which	require	less	training	data	and	generalise	better	
•  Honesty	
•  Interpretability	of	results	and	model	saliency	
•  Causal	reasoning		
•  Avoid	reward	hacking	
1.  Rowan	McAllister,	Yarin	Gal,	Alex	Kendall,	Mark	van	der	Wilk,	Amar	Shah,	Roberto	Cipolla,	and	Adrian	Weller.	Concrete	Problems	for	Autonomous	
Vehicle	Safety:	Advantages	of	Bayesian	Deep	Learning.	IJCAI,	2017.
1.  Alex	Kendall	and	Yarin	Gal.	What	Uncertainties	Do	We	Need	in	Bayesian	Deep	Learning	for	Computer	Vision?	Advances	in	Neural	Information	
Processing	Systems	(NIPS),	2017.	
Input	Video	 Semantic	Segmentation	 Uncertainty
Conclusions	
•  We	need	machine	learning	to	scale	to	hard	problems	with	intelligent	
robots	–	hand	engineering	isn’t	good	enough	
•  We	can	learning	to	perceive	and	act	from	data	with	deep	learning	
•  We	cannot	explicitly	reason	about	ethical	situations	on	a	case-by-case	
basis	–	our	models	need	to	understand	ethics	themselves	
•  Computer	vision	is	holding	back	robotics	from	real-world	applications
alexgkendall.com/publica8ons/

@alexgkendall

agk34@cam.ac.uk

Thank you to the amazing people who made this work possible:
Roberto Cipolla, Vijay Badrinarayanan, Yarin Gal, Tom Roddick, MaMhew Grimes,
Adrian Weller, Amar Shah, Hayk Mar8rosyan, Saumitro Dasgupta, Peter Henry,
Ryan Kennedy, Abe Bachrach, Adam Bry
1 de 18

Recomendados

10 esminių informatikos idėjų. Valentina DAGIENĖ por
10 esminių informatikos idėjų. Valentina DAGIENĖ10 esminių informatikos idėjų. Valentina DAGIENĖ
10 esminių informatikos idėjų. Valentina DAGIENĖLietuvos kompiuterininkų sąjunga
115 vistas49 diapositivas
IRJET- Privacy Issues in Content based Image Retrieval (CBIR) for Mobile ... por
IRJET-  	  Privacy Issues in Content based Image Retrieval (CBIR) for Mobile ...IRJET-  	  Privacy Issues in Content based Image Retrieval (CBIR) for Mobile ...
IRJET- Privacy Issues in Content based Image Retrieval (CBIR) for Mobile ...IRJET Journal
22 vistas6 diapositivas
Lifelogging, egocentric vision and health: how a small wearable camera can he... por
Lifelogging, egocentric vision and health: how a small wearable camera can he...Lifelogging, egocentric vision and health: how a small wearable camera can he...
Lifelogging, egocentric vision and health: how a small wearable camera can he...Petia Radeva
753 vistas58 diapositivas
Visualisatie voor transparante beslissingen - Big Data Expo 2019 por
Visualisatie voor transparante beslissingen - Big Data Expo 2019Visualisatie voor transparante beslissingen - Big Data Expo 2019
Visualisatie voor transparante beslissingen - Big Data Expo 2019webwinkelvakdag
115 vistas28 diapositivas
Thesis Studio I - Midterm por
Thesis Studio I - MidtermThesis Studio I - Midterm
Thesis Studio I - MidtermKelly Nichols
212 vistas34 diapositivas
Practical Problem Solving Using Mobile Technology por
Practical Problem Solving Using Mobile TechnologyPractical Problem Solving Using Mobile Technology
Practical Problem Solving Using Mobile TechnologyNTEN
724 vistas78 diapositivas

Más contenido relacionado

Similar a Building intelligent robots

323462348 por
323462348323462348
323462348Shubhangi Kirange
116 vistas39 diapositivas
323462348 por
323462348323462348
323462348DrShubhangiDnyaneshw
97 vistas39 diapositivas
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ... por
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...Bond University
366 vistas29 diapositivas
Age and Gender Prediction and Human count por
Age and Gender Prediction and Human countAge and Gender Prediction and Human count
Age and Gender Prediction and Human countIRJET Journal
12 vistas6 diapositivas
Infrastructure for digital pathology in a tissue bank por
Infrastructure for digital pathology in a tissue bankInfrastructure for digital pathology in a tissue bank
Infrastructure for digital pathology in a tissue bankBIT002
269 vistas1 diapositiva
face mask detection ppt66 (1)M M.pptx por
face mask detection ppt66 (1)M M.pptxface mask detection ppt66 (1)M M.pptx
face mask detection ppt66 (1)M M.pptxShreyaMishra883730
112 vistas18 diapositivas

Similar a Building intelligent robots(20)

Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ... por Bond University
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
Bond University366 vistas
Age and Gender Prediction and Human count por IRJET Journal
Age and Gender Prediction and Human countAge and Gender Prediction and Human count
Age and Gender Prediction and Human count
IRJET Journal12 vistas
Infrastructure for digital pathology in a tissue bank por BIT002
Infrastructure for digital pathology in a tissue bankInfrastructure for digital pathology in a tissue bank
Infrastructure for digital pathology in a tissue bank
BIT002269 vistas
Week1- Introduction.pptx por fahmi324663
Week1- Introduction.pptxWeek1- Introduction.pptx
Week1- Introduction.pptx
fahmi3246634 vistas
Raai 2019 clinical unmet needs and its solutions of deep learning in medicine3 por Namkug Kim
Raai 2019 clinical unmet needs and its solutions of deep learning in medicine3Raai 2019 clinical unmet needs and its solutions of deep learning in medicine3
Raai 2019 clinical unmet needs and its solutions of deep learning in medicine3
Namkug Kim5.4K vistas
Group7midterm 200404081547 por Rodel Septimo
Group7midterm 200404081547Group7midterm 200404081547
Group7midterm 200404081547
Rodel Septimo30 vistas
20170315 Cloud Accelerated Genomics - Tel Aviv / Phoenix por Allen Day, PhD
20170315 Cloud Accelerated Genomics - Tel Aviv / Phoenix20170315 Cloud Accelerated Genomics - Tel Aviv / Phoenix
20170315 Cloud Accelerated Genomics - Tel Aviv / Phoenix
Allen Day, PhD456 vistas
Cloud Accelerated Genomics por Idan Tohami
Cloud Accelerated GenomicsCloud Accelerated Genomics
Cloud Accelerated Genomics
Idan Tohami1.1K vistas
Huawei STW 2018 public por Alan Smeaton
Huawei STW 2018 publicHuawei STW 2018 public
Huawei STW 2018 public
Alan Smeaton866 vistas
Advanced Fuzzy Logic Based Image Watermarking Technique for Medical Images por IJARIIT
Advanced Fuzzy Logic Based Image Watermarking Technique for Medical ImagesAdvanced Fuzzy Logic Based Image Watermarking Technique for Medical Images
Advanced Fuzzy Logic Based Image Watermarking Technique for Medical Images
IJARIIT29 vistas
Review of Pose Recognition Systems por vivatechijri
Review of Pose Recognition SystemsReview of Pose Recognition Systems
Review of Pose Recognition Systems
vivatechijri37 vistas
Vid-Ability: a Portable Computing Project Using Instructional Video to Impro... por Ann Davidson
Vid-Ability: a Portable Computing Project  Using Instructional Video to Impro...Vid-Ability: a Portable Computing Project  Using Instructional Video to Impro...
Vid-Ability: a Portable Computing Project Using Instructional Video to Impro...
Ann Davidson611 vistas
Deep Visual Understanding from Deep Learning by Prof. Jitendra Malik por The Hive
Deep Visual Understanding from Deep Learning by Prof. Jitendra MalikDeep Visual Understanding from Deep Learning by Prof. Jitendra Malik
Deep Visual Understanding from Deep Learning by Prof. Jitendra Malik
The Hive2.4K vistas

Más de Justin Hayward

Grid-scale energy storage por
Grid-scale energy storageGrid-scale energy storage
Grid-scale energy storageJustin Hayward
237 vistas12 diapositivas
Life Sciences Investment Platform por
Life Sciences Investment PlatformLife Sciences Investment Platform
Life Sciences Investment PlatformJustin Hayward
58 vistas26 diapositivas
Polymer Applications por
Polymer ApplicationsPolymer Applications
Polymer ApplicationsJustin Hayward
79 vistas20 diapositivas
Flexible Organic LCD por
Flexible Organic LCDFlexible Organic LCD
Flexible Organic LCDJustin Hayward
88 vistas20 diapositivas
Grand challenges for engineering por
Grand challenges for engineeringGrand challenges for engineering
Grand challenges for engineeringJustin Hayward
91 vistas17 diapositivas
Inkjet in advanced manufacturing por
Inkjet in advanced manufacturingInkjet in advanced manufacturing
Inkjet in advanced manufacturingJustin Hayward
70 vistas34 diapositivas

Más de Justin Hayward(20)

Life Sciences Investment Platform por Justin Hayward
Life Sciences Investment PlatformLife Sciences Investment Platform
Life Sciences Investment Platform
Justin Hayward58 vistas
Grand challenges for engineering por Justin Hayward
Grand challenges for engineeringGrand challenges for engineering
Grand challenges for engineering
Justin Hayward91 vistas
Inkjet in advanced manufacturing por Justin Hayward
Inkjet in advanced manufacturingInkjet in advanced manufacturing
Inkjet in advanced manufacturing
Justin Hayward70 vistas
Materials, energy, storage and heat transfer por Justin Hayward
Materials, energy, storage and heat transferMaterials, energy, storage and heat transfer
Materials, energy, storage and heat transfer
Justin Hayward73 vistas
Connectivity and IoT Ecosystems por Justin Hayward
Connectivity and IoT EcosystemsConnectivity and IoT Ecosystems
Connectivity and IoT Ecosystems
Justin Hayward42 vistas
Top 5 breakthroughs in energy storage materials por Justin Hayward
Top 5 breakthroughs in energy storage materialsTop 5 breakthroughs in energy storage materials
Top 5 breakthroughs in energy storage materials
Justin Hayward54 vistas
Graphene heating for wearable devices por Justin Hayward
Graphene heating for wearable devicesGraphene heating for wearable devices
Graphene heating for wearable devices
Justin Hayward55 vistas
Energy storage materials por Justin Hayward
Energy storage materialsEnergy storage materials
Energy storage materials
Justin Hayward1.4K vistas
Breakthroughs in new materials por Justin Hayward
Breakthroughs in new materialsBreakthroughs in new materials
Breakthroughs in new materials
Justin Hayward59 vistas

Último

[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ... por
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...DataScienceConferenc1
6 vistas15 diapositivas
Chapter 3b- Process Communication (1) (1)(1) (1).pptx por
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptxayeshabaig2004
7 vistas30 diapositivas
VoxelNet por
VoxelNetVoxelNet
VoxelNettaeseon ryu
13 vistas21 diapositivas
Organic Shopping in Google Analytics 4.pdf por
Organic Shopping in Google Analytics 4.pdfOrganic Shopping in Google Analytics 4.pdf
Organic Shopping in Google Analytics 4.pdfGA4 Tutorials
16 vistas13 diapositivas
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx por
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptxDataScienceConferenc1
5 vistas12 diapositivas
UNEP FI CRS Climate Risk Results.pptx por
UNEP FI CRS Climate Risk Results.pptxUNEP FI CRS Climate Risk Results.pptx
UNEP FI CRS Climate Risk Results.pptxpekka28
11 vistas51 diapositivas

Último(20)

[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ... por DataScienceConferenc1
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
Chapter 3b- Process Communication (1) (1)(1) (1).pptx por ayeshabaig2004
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptx
ayeshabaig20047 vistas
Organic Shopping in Google Analytics 4.pdf por GA4 Tutorials
Organic Shopping in Google Analytics 4.pdfOrganic Shopping in Google Analytics 4.pdf
Organic Shopping in Google Analytics 4.pdf
GA4 Tutorials16 vistas
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx por DataScienceConferenc1
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
UNEP FI CRS Climate Risk Results.pptx por pekka28
UNEP FI CRS Climate Risk Results.pptxUNEP FI CRS Climate Risk Results.pptx
UNEP FI CRS Climate Risk Results.pptx
pekka2811 vistas
[DSC Europe 23][Cryptica] Martin_Summer_Digital_central_bank_money_Ideas_init... por DataScienceConferenc1
[DSC Europe 23][Cryptica] Martin_Summer_Digital_central_bank_money_Ideas_init...[DSC Europe 23][Cryptica] Martin_Summer_Digital_central_bank_money_Ideas_init...
[DSC Europe 23][Cryptica] Martin_Summer_Digital_central_bank_money_Ideas_init...
CRM stick or twist workshop por info828217
CRM stick or twist workshopCRM stick or twist workshop
CRM stick or twist workshop
info82821711 vistas
CRM stick or twist.pptx por info828217
CRM stick or twist.pptxCRM stick or twist.pptx
CRM stick or twist.pptx
info82821711 vistas
[DSC Europe 23] Ivana Sesic - Use of AI in Public Health.pptx por DataScienceConferenc1
[DSC Europe 23] Ivana Sesic - Use of AI in Public Health.pptx[DSC Europe 23] Ivana Sesic - Use of AI in Public Health.pptx
[DSC Europe 23] Ivana Sesic - Use of AI in Public Health.pptx
SUPER STORE SQL PROJECT.pptx por khan888620
SUPER STORE SQL PROJECT.pptxSUPER STORE SQL PROJECT.pptx
SUPER STORE SQL PROJECT.pptx
khan88862013 vistas
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M... por DataScienceConferenc1
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...
Ukraine Infographic_22NOV2023_v2.pdf por AnastosiyaGurin
Ukraine Infographic_22NOV2023_v2.pdfUkraine Infographic_22NOV2023_v2.pdf
Ukraine Infographic_22NOV2023_v2.pdf
AnastosiyaGurin1.4K vistas
PRIVACY AWRE PERSONAL DATA STORAGE por antony420421
PRIVACY AWRE PERSONAL DATA STORAGEPRIVACY AWRE PERSONAL DATA STORAGE
PRIVACY AWRE PERSONAL DATA STORAGE
antony4204215 vistas
Cross-network in Google Analytics 4.pdf por GA4 Tutorials
Cross-network in Google Analytics 4.pdfCross-network in Google Analytics 4.pdf
Cross-network in Google Analytics 4.pdf
GA4 Tutorials6 vistas

Building intelligent robots