SlideShare una empresa de Scribd logo
1 de 27
Descargar para leer sin conexión
Object Extraction from
Satellite Imagery using
Deep Learning
Aly Osama
Presenter
• Aly Osama
• Research Software Development
Engineer at Microsoft
• Contact:
• Email: alyosamah@gmail.com
• https://www.linkedin.com/in/alyosa
ma/
• https://github.com/alyosama
Agenda
1. Needed data, its size,
2. How training will go,
3. How evaluation should be carried,
4. What learning tools would you see and why?
5. Literature survey on the subject
6. Code sample/preliminary results
Overview
Key Words:-
1. Satellite Imagery
2. Object Extraction
3. Deep Learning
4. Python
1. Satellite Imagery
• Objects are often very small (~20 pixels in
size ) as example 0.5m/pixel
• Input images are enormous (often
hundreds of megapixels).
• Image has more than 3 channels (RGB)
called bands.
• Image Format:
• Images (GeoTiff , … etc )
• Labels ( GeoJSON , WTK )
• On the positive side,
• The physical and pixel scale of objects
are usually known in advance
• There’s a low variation in observation
angle.
Datasets
• SpaceNet
• Source : https://aws.amazon.com/public-
datasets/spacenet/
• Tutorial https://medium.com/the-
downlinq/building-extraction-with-yolt2-and-
spacenet-data-a926f9ffac4f
• 5 Solutions:
https://github.com/SpaceNetChallenge/BuildingD
etectors
• DSTL Satellite Imagery (Kaggle Competition )
• https://www.kaggle.com/c/dstl-satellite-imagery-
feature-detection
• Tutorial : https://www.kaggle.com/torrinos/dstl-
satellite-imagery-feature-detection/exploration-
and-plotting/run/553107
• DeepSat
• UC Merced land
• Satellite Websites
• https://modis.gsfc.nasa.gov/
• https://sentinel.esa.int/web/sentinel/home
• https://landsat.usgs.gov/
2. Training
• Experiments
1. VGGNet. - (Baseline)
• Tune the pretrained model – Transfer
Learning – based on available data
• Data Augmentation like
• Random Crops / Scales
• Color Jitter
2. Faster RCNN or YOLO
• For Detection and Localization
General Tips
3.Evaluation
• Accuracy :D
• Precession and Recall
• Jaccard index (
Intersection over
Union)
4. tools
• Hardware
• Deep Learning AMI Amazon Linux Version
• https://aws.amazon.com/marketplace/pp/B01M0AXXQB
• Powerful Machine with GPUs
• NVIDIA GTX Titan X
• Software
• Caffe + Python
• Pretrained models
• Lasagne / Keras Framework
• High level Python
• Backend independent “Tensorflow or Theano”
• Multi-GPU
• Caffe2 ( 18-4-2017 )
• Utility
• QGIS is an open-source tool for managing and editing GeoTIFFs and
geoJSON files
Tools Comparison
5. Literature survey
on the subject
1- A Survey on
Object Detection
in Optical
Remote Sensing
Images 2016
Gong Cheng,
Junwei Han*
Cheng et al. 2016
Cheng et al. 2016
• Deep Learning Papers
• (Han et al., 2015;Tang et al.,
2015; Wang et al., 2015; Zhou et
al., 2015b)
• Datasets
• NWPU VHR-10 dataset (Cheng et
al., 2014a)1.
• SZTAKI-INRIA building detection
dataset (Benedek et al., 2012)2.
• TAS aerial car detection dataset
(Heitz and Koller, 2008)3.
• Overhead imagery research
dataset (OIRDS) (Tanner et al.,
2009)
• IITM road extraction dataset
(Das et al., 2011)5.
FAST AIRCRAFT DETECTION IN SATELLITE IMAGES BASED ON CONVOLUTIONAL NEURAL NETWORKS
(Wu et. Al.) 2015
Region Proposals
TODO : Search on R-CNN
FULLY CONVOLUTIONAL NETWORKS FOR
BUILDING AND ROAD EXTRACTION:
PRELIMINARY RESULTS 2016 Zilong Zhong
• Dataset
• Massachusetts’ road dataset and building dataset
• each image consists of 3×1500×1500 pixels
• contains 1,711 aerial images,
• the FCN’s computation consumption could be much
higher than that of the ordinary object recognition
models.
Building detection in very high resolution
multispectral data with deep learning features
2016
• AlexNet -> Features + SVM ( Last layer )
Road network extraction a neural-dynamic
framework based on deep learning and a finite
state machine wang2015
CNN + FSM
( for
sequence )
Do Deep Features Generalize from Everyday Objects
to Remote Sensing and Aerial Scenes Domains? 2016
Ot´avio A. B. Penatti
• ConvNet using Caffe and OverFeat
Using convolutional networks and satellite imagery to
identify pa.erns in
urban environments at a large scale
ADRIAN ALBERT*, Massachuse.s Institute of
Technology2017
• Dataset :
• UC Merced land use dataset [25] (of 2100
images spanning 21 classes)
• DeepSat land use benchmark dataset ( 4
channels
• (VGGNet and ResNet)
6. Code
sample/prelim
inary results
• (Test) DSTL
• https://www.kaggle.com/alyosama/dstl-
satellite-imagery-feature-
detection/convnet-baseline/
YOLT2
• The actual F1 score of 0.21
• Jaccard index between 0.4 and 0.5
https://medium.com/the-downlinq/building-extraction-with-yolt2-and-spacenet-data-a926f9ffac4fT
CosmiQNet
• Blackbox Fully Convolution
Neural Network: CosmiQNet.
The inputs are at two
resolutions and the output
distance transform matches the
lower of the input resolutions.
The resolution of the 8-band
GeoTIFF is roughly one quarter
(in each dimension) the
resolution of the the 3-band
GeoTIFF; the difference in
resolution is depicted by the
scale of the GeoTIFFs.
https://medium.com/the-downlinq/object-detection-on-
spacenet-5e691961d257
Resources
1. DSTL Satellite Imagery Competiton
2. https://medium.com/@avanetten
3. https://www.kernix.com/blog/image-
classification-with-a-pre-trained-deep-
neural-network_p11
alyosamah@gmail.com
Thank you

Más contenido relacionado

La actualidad más candente

Digital Image Processing
Digital Image ProcessingDigital Image Processing
Digital Image ProcessingSahil Biswas
 
Semantic Segmentation on Satellite Imagery
Semantic Segmentation on Satellite ImagerySemantic Segmentation on Satellite Imagery
Semantic Segmentation on Satellite ImageryRAHUL BHOJWANI
 
PhD Completion Seminar
PhD Completion Seminar PhD Completion Seminar
PhD Completion Seminar Simone Romano
 
Landuse Classification from Satellite Imagery using Deep Learning
Landuse Classification from Satellite Imagery using Deep LearningLanduse Classification from Satellite Imagery using Deep Learning
Landuse Classification from Satellite Imagery using Deep LearningDataWorks Summit
 
Using deep learning in remote sensing
Using deep learning in remote sensingUsing deep learning in remote sensing
Using deep learning in remote sensingMohamed Yousif
 
Remote Sensing - Fundamentals
Remote Sensing - FundamentalsRemote Sensing - Fundamentals
Remote Sensing - FundamentalsAjay Singh Lodhi
 
visual Positioning System
visual Positioning Systemvisual Positioning System
visual Positioning SystemIlyas Arafath
 
Wavelet based image fusion
Wavelet based image fusionWavelet based image fusion
Wavelet based image fusionUmed Paliwal
 
Introduction to OpenStreetMap
Introduction to OpenStreetMapIntroduction to OpenStreetMap
Introduction to OpenStreetMapKate Chapman
 
IMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSINGIMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSINGgarima0690
 
IMED 2018: An intro to Remote Sensing and Machine Learning
IMED 2018: An intro to Remote Sensing and Machine LearningIMED 2018: An intro to Remote Sensing and Machine Learning
IMED 2018: An intro to Remote Sensing and Machine LearningLouisa Diggs
 
Human Pose Estimation by Deep Learning
Human Pose Estimation by Deep LearningHuman Pose Estimation by Deep Learning
Human Pose Estimation by Deep LearningWei Yang
 
Image classification
Image classificationImage classification
Image classificationAnchor Charan
 
Image classification and land cover mapping
Image classification and land cover mappingImage classification and land cover mapping
Image classification and land cover mappingKabir Uddin
 

La actualidad más candente (20)

Gps signal structure
Gps signal structureGps signal structure
Gps signal structure
 
Digital Image Processing
Digital Image ProcessingDigital Image Processing
Digital Image Processing
 
Semantic Segmentation on Satellite Imagery
Semantic Segmentation on Satellite ImagerySemantic Segmentation on Satellite Imagery
Semantic Segmentation on Satellite Imagery
 
PhD Completion Seminar
PhD Completion Seminar PhD Completion Seminar
PhD Completion Seminar
 
Landuse Classification from Satellite Imagery using Deep Learning
Landuse Classification from Satellite Imagery using Deep LearningLanduse Classification from Satellite Imagery using Deep Learning
Landuse Classification from Satellite Imagery using Deep Learning
 
Using deep learning in remote sensing
Using deep learning in remote sensingUsing deep learning in remote sensing
Using deep learning in remote sensing
 
Remote sensing
Remote sensingRemote sensing
Remote sensing
 
Remote Sensing - Fundamentals
Remote Sensing - FundamentalsRemote Sensing - Fundamentals
Remote Sensing - Fundamentals
 
visual Positioning System
visual Positioning Systemvisual Positioning System
visual Positioning System
 
Digital photogrammetry
Digital photogrammetryDigital photogrammetry
Digital photogrammetry
 
Wavelet based image fusion
Wavelet based image fusionWavelet based image fusion
Wavelet based image fusion
 
Introduction to OpenStreetMap
Introduction to OpenStreetMapIntroduction to OpenStreetMap
Introduction to OpenStreetMap
 
IMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSINGIMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSING
 
GIS
GISGIS
GIS
 
IMED 2018: An intro to Remote Sensing and Machine Learning
IMED 2018: An intro to Remote Sensing and Machine LearningIMED 2018: An intro to Remote Sensing and Machine Learning
IMED 2018: An intro to Remote Sensing and Machine Learning
 
Mobile gis
Mobile gisMobile gis
Mobile gis
 
Human Pose Estimation by Deep Learning
Human Pose Estimation by Deep LearningHuman Pose Estimation by Deep Learning
Human Pose Estimation by Deep Learning
 
Image classification
Image classificationImage classification
Image classification
 
Three dimensional (3D) GIS
Three dimensional (3D) GISThree dimensional (3D) GIS
Three dimensional (3D) GIS
 
Image classification and land cover mapping
Image classification and land cover mappingImage classification and land cover mapping
Image classification and land cover mapping
 

Similar a Object extraction from satellite imagery using deep learning

Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsDatabricks
 
Computer vision for transportation
Computer vision for transportationComputer vision for transportation
Computer vision for transportationWanjin Yu
 
PhD Thesis Proposal
PhD Thesis Proposal PhD Thesis Proposal
PhD Thesis Proposal Ziqiang Feng
 
HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...
HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...
HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...Tulipp. Eu
 
FPT17: An object detector based on multiscale sliding window search using a f...
FPT17: An object detector based on multiscale sliding window search using a f...FPT17: An object detector based on multiscale sliding window search using a f...
FPT17: An object detector based on multiscale sliding window search using a f...Hiroki Nakahara
 
Large Scale Image Forensics using Tika and Tensorflow [ICMR MFSec 2017]
Large Scale Image Forensics using Tika and Tensorflow [ICMR MFSec 2017]Large Scale Image Forensics using Tika and Tensorflow [ICMR MFSec 2017]
Large Scale Image Forensics using Tika and Tensorflow [ICMR MFSec 2017]Thamme Gowda
 
Rack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRebekah Rodriguez
 
Mobile Visual Search: Object Re-Identification Against Large Repositories
Mobile Visual Search: Object Re-Identification Against Large RepositoriesMobile Visual Search: Object Re-Identification Against Large Repositories
Mobile Visual Search: Object Re-Identification Against Large RepositoriesUnited States Air Force Academy
 
Adoption of Software By A User Community: The Montage Image Mosaic Engine Exa...
Adoption of Software By A User Community: The Montage Image Mosaic Engine Exa...Adoption of Software By A User Community: The Montage Image Mosaic Engine Exa...
Adoption of Software By A User Community: The Montage Image Mosaic Engine Exa...SoftwarePractice
 
Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learningpratik pratyay
 
Big data at experimental facilities
Big data at experimental facilitiesBig data at experimental facilities
Big data at experimental facilitiesIan Foster
 
Weave-D - 2nd Progress Evaluation Presentation
Weave-D - 2nd Progress Evaluation PresentationWeave-D - 2nd Progress Evaluation Presentation
Weave-D - 2nd Progress Evaluation Presentationlasinducharith
 
Image Classification (20230411)
Image Classification (20230411)Image Classification (20230411)
Image Classification (20230411)FEG
 
Big Data Analysis : Deciphering the haystack
Big Data Analysis : Deciphering the haystack Big Data Analysis : Deciphering the haystack
Big Data Analysis : Deciphering the haystack Srinath Perera
 
Object Detection Beyond Mask R-CNN and RetinaNet I
Object Detection Beyond Mask R-CNN and RetinaNet IObject Detection Beyond Mask R-CNN and RetinaNet I
Object Detection Beyond Mask R-CNN and RetinaNet IWanjin Yu
 
[CVPR 2018] Utilizing unlabeled or noisy labeled data (classification, detect...
[CVPR 2018] Utilizing unlabeled or noisy labeled data (classification, detect...[CVPR 2018] Utilizing unlabeled or noisy labeled data (classification, detect...
[CVPR 2018] Utilizing unlabeled or noisy labeled data (classification, detect...NAVER Engineering
 

Similar a Object extraction from satellite imagery using deep learning (20)

Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science Workflows
 
Computer vision for transportation
Computer vision for transportationComputer vision for transportation
Computer vision for transportation
 
PhD Thesis Proposal
PhD Thesis Proposal PhD Thesis Proposal
PhD Thesis Proposal
 
HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...
HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...
HiPEAC 2019 Workshop - Real-Time Modelling Visual Scenes with Biological Insp...
 
Project Matsu
Project MatsuProject Matsu
Project Matsu
 
FPT17: An object detector based on multiscale sliding window search using a f...
FPT17: An object detector based on multiscale sliding window search using a f...FPT17: An object detector based on multiscale sliding window search using a f...
FPT17: An object detector based on multiscale sliding window search using a f...
 
Large Scale Image Forensics using Tika and Tensorflow [ICMR MFSec 2017]
Large Scale Image Forensics using Tika and Tensorflow [ICMR MFSec 2017]Large Scale Image Forensics using Tika and Tensorflow [ICMR MFSec 2017]
Large Scale Image Forensics using Tika and Tensorflow [ICMR MFSec 2017]
 
Rack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC Supercomputer
 
Mobile Visual Search: Object Re-Identification Against Large Repositories
Mobile Visual Search: Object Re-Identification Against Large RepositoriesMobile Visual Search: Object Re-Identification Against Large Repositories
Mobile Visual Search: Object Re-Identification Against Large Repositories
 
Adoption of Software By A User Community: The Montage Image Mosaic Engine Exa...
Adoption of Software By A User Community: The Montage Image Mosaic Engine Exa...Adoption of Software By A User Community: The Montage Image Mosaic Engine Exa...
Adoption of Software By A User Community: The Montage Image Mosaic Engine Exa...
 
Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learning
 
slide-171212080528.pptx
slide-171212080528.pptxslide-171212080528.pptx
slide-171212080528.pptx
 
Big data at experimental facilities
Big data at experimental facilitiesBig data at experimental facilities
Big data at experimental facilities
 
Weave-D - 2nd Progress Evaluation Presentation
Weave-D - 2nd Progress Evaluation PresentationWeave-D - 2nd Progress Evaluation Presentation
Weave-D - 2nd Progress Evaluation Presentation
 
Image Classification (20230411)
Image Classification (20230411)Image Classification (20230411)
Image Classification (20230411)
 
Big Data Analysis : Deciphering the haystack
Big Data Analysis : Deciphering the haystack Big Data Analysis : Deciphering the haystack
Big Data Analysis : Deciphering the haystack
 
Bachelor-Thesis
Bachelor-ThesisBachelor-Thesis
Bachelor-Thesis
 
CINET: A CyberInfrastructure for Network Science
CINET: A CyberInfrastructure for Network ScienceCINET: A CyberInfrastructure for Network Science
CINET: A CyberInfrastructure for Network Science
 
Object Detection Beyond Mask R-CNN and RetinaNet I
Object Detection Beyond Mask R-CNN and RetinaNet IObject Detection Beyond Mask R-CNN and RetinaNet I
Object Detection Beyond Mask R-CNN and RetinaNet I
 
[CVPR 2018] Utilizing unlabeled or noisy labeled data (classification, detect...
[CVPR 2018] Utilizing unlabeled or noisy labeled data (classification, detect...[CVPR 2018] Utilizing unlabeled or noisy labeled data (classification, detect...
[CVPR 2018] Utilizing unlabeled or noisy labeled data (classification, detect...
 

Más de Aly Abdelkareem

An Inductive inference Machine
An Inductive inference MachineAn Inductive inference Machine
An Inductive inference MachineAly Abdelkareem
 
Digital Image Processing - Frequency Filters
Digital Image Processing - Frequency FiltersDigital Image Processing - Frequency Filters
Digital Image Processing - Frequency FiltersAly Abdelkareem
 
Deep learning: Overfitting , underfitting, and regularization
Deep learning: Overfitting , underfitting, and regularizationDeep learning: Overfitting , underfitting, and regularization
Deep learning: Overfitting , underfitting, and regularizationAly Abdelkareem
 
Practical Digital Image Processing 5
Practical Digital Image Processing 5Practical Digital Image Processing 5
Practical Digital Image Processing 5Aly Abdelkareem
 
Practical Digital Image Processing 4
Practical Digital Image Processing 4Practical Digital Image Processing 4
Practical Digital Image Processing 4Aly Abdelkareem
 
Practical Digital Image Processing 3
 Practical Digital Image Processing 3 Practical Digital Image Processing 3
Practical Digital Image Processing 3Aly Abdelkareem
 
Pattern recognition 4 - MLE
Pattern recognition 4 - MLEPattern recognition 4 - MLE
Pattern recognition 4 - MLEAly Abdelkareem
 
Practical Digital Image Processing 2
Practical Digital Image Processing 2Practical Digital Image Processing 2
Practical Digital Image Processing 2Aly Abdelkareem
 
Practical Digital Image Processing 1
Practical Digital Image Processing 1Practical Digital Image Processing 1
Practical Digital Image Processing 1Aly Abdelkareem
 
Machine Learning for Everyone
Machine Learning for EveryoneMachine Learning for Everyone
Machine Learning for EveryoneAly Abdelkareem
 
How to use deep learning on biological data
How to use deep learning on biological dataHow to use deep learning on biological data
How to use deep learning on biological dataAly Abdelkareem
 
Deep Learning using Keras
Deep Learning using KerasDeep Learning using Keras
Deep Learning using KerasAly Abdelkareem
 
Pattern recognition Tutorial 2
Pattern recognition Tutorial 2Pattern recognition Tutorial 2
Pattern recognition Tutorial 2Aly Abdelkareem
 
Android Udacity Study group 1
Android Udacity Study group 1Android Udacity Study group 1
Android Udacity Study group 1Aly Abdelkareem
 
Java for android developers
Java for android developersJava for android developers
Java for android developersAly Abdelkareem
 
Introduction to Android Development
Introduction to Android DevelopmentIntroduction to Android Development
Introduction to Android DevelopmentAly Abdelkareem
 

Más de Aly Abdelkareem (16)

An Inductive inference Machine
An Inductive inference MachineAn Inductive inference Machine
An Inductive inference Machine
 
Digital Image Processing - Frequency Filters
Digital Image Processing - Frequency FiltersDigital Image Processing - Frequency Filters
Digital Image Processing - Frequency Filters
 
Deep learning: Overfitting , underfitting, and regularization
Deep learning: Overfitting , underfitting, and regularizationDeep learning: Overfitting , underfitting, and regularization
Deep learning: Overfitting , underfitting, and regularization
 
Practical Digital Image Processing 5
Practical Digital Image Processing 5Practical Digital Image Processing 5
Practical Digital Image Processing 5
 
Practical Digital Image Processing 4
Practical Digital Image Processing 4Practical Digital Image Processing 4
Practical Digital Image Processing 4
 
Practical Digital Image Processing 3
 Practical Digital Image Processing 3 Practical Digital Image Processing 3
Practical Digital Image Processing 3
 
Pattern recognition 4 - MLE
Pattern recognition 4 - MLEPattern recognition 4 - MLE
Pattern recognition 4 - MLE
 
Practical Digital Image Processing 2
Practical Digital Image Processing 2Practical Digital Image Processing 2
Practical Digital Image Processing 2
 
Practical Digital Image Processing 1
Practical Digital Image Processing 1Practical Digital Image Processing 1
Practical Digital Image Processing 1
 
Machine Learning for Everyone
Machine Learning for EveryoneMachine Learning for Everyone
Machine Learning for Everyone
 
How to use deep learning on biological data
How to use deep learning on biological dataHow to use deep learning on biological data
How to use deep learning on biological data
 
Deep Learning using Keras
Deep Learning using KerasDeep Learning using Keras
Deep Learning using Keras
 
Pattern recognition Tutorial 2
Pattern recognition Tutorial 2Pattern recognition Tutorial 2
Pattern recognition Tutorial 2
 
Android Udacity Study group 1
Android Udacity Study group 1Android Udacity Study group 1
Android Udacity Study group 1
 
Java for android developers
Java for android developersJava for android developers
Java for android developers
 
Introduction to Android Development
Introduction to Android DevelopmentIntroduction to Android Development
Introduction to Android Development
 

Último

The basics of sentences session 8pptx.pptx
The basics of sentences session 8pptx.pptxThe basics of sentences session 8pptx.pptx
The basics of sentences session 8pptx.pptxheathfieldcps1
 
3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptxmary850239
 
Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024bsellato
 
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfPHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfSumit Tiwari
 
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17Celine George
 
The OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
The OERs: Transforming Education for Sustainable Future by Dr. Sarita AnandThe OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
The OERs: Transforming Education for Sustainable Future by Dr. Sarita AnandDr. Sarita Anand
 
Arti Languages Pre Seed Send Ahead Pitchdeck 2024.pdf
Arti Languages Pre Seed Send Ahead Pitchdeck 2024.pdfArti Languages Pre Seed Send Ahead Pitchdeck 2024.pdf
Arti Languages Pre Seed Send Ahead Pitchdeck 2024.pdfwill854175
 
Quantitative research methodology and survey design
Quantitative research methodology and survey designQuantitative research methodology and survey design
Quantitative research methodology and survey designBalelaBoru
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudDr. Bruce A. Johnson
 
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...Marlene Maheu
 
Plant Tissue culture., Plasticity, Totipotency, pptx
Plant Tissue culture., Plasticity, Totipotency, pptxPlant Tissue culture., Plasticity, Totipotency, pptx
Plant Tissue culture., Plasticity, Totipotency, pptxHimansu10
 
Alamkara theory by Bhamaha Indian Poetics (1).pptx
Alamkara theory by Bhamaha Indian Poetics (1).pptxAlamkara theory by Bhamaha Indian Poetics (1).pptx
Alamkara theory by Bhamaha Indian Poetics (1).pptxDhatriParmar
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...Nguyen Thanh Tu Collection
 
VIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfVIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfArthyR3
 
LEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollLEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollDr. Bruce A. Johnson
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...Nguyen Thanh Tu Collection
 
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxMetabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxDr. Santhosh Kumar. N
 
ICS2208 Lecture4 Intelligent Interface Agents.pdf
ICS2208 Lecture4 Intelligent Interface Agents.pdfICS2208 Lecture4 Intelligent Interface Agents.pdf
ICS2208 Lecture4 Intelligent Interface Agents.pdfVanessa Camilleri
 

Último (20)

The basics of sentences session 8pptx.pptx
The basics of sentences session 8pptx.pptxThe basics of sentences session 8pptx.pptx
The basics of sentences session 8pptx.pptx
 
3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx
 
Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024
 
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfPHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
 
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
 
The OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
The OERs: Transforming Education for Sustainable Future by Dr. Sarita AnandThe OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
The OERs: Transforming Education for Sustainable Future by Dr. Sarita Anand
 
Arti Languages Pre Seed Send Ahead Pitchdeck 2024.pdf
Arti Languages Pre Seed Send Ahead Pitchdeck 2024.pdfArti Languages Pre Seed Send Ahead Pitchdeck 2024.pdf
Arti Languages Pre Seed Send Ahead Pitchdeck 2024.pdf
 
Quantitative research methodology and survey design
Quantitative research methodology and survey designQuantitative research methodology and survey design
Quantitative research methodology and survey design
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced Stud
 
Least Significance Difference:Biostatics and Research Methodology
Least Significance Difference:Biostatics and Research MethodologyLeast Significance Difference:Biostatics and Research Methodology
Least Significance Difference:Biostatics and Research Methodology
 
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
 
t-test Parametric test Biostatics and Research Methodology
t-test Parametric test Biostatics and Research Methodologyt-test Parametric test Biostatics and Research Methodology
t-test Parametric test Biostatics and Research Methodology
 
Plant Tissue culture., Plasticity, Totipotency, pptx
Plant Tissue culture., Plasticity, Totipotency, pptxPlant Tissue culture., Plasticity, Totipotency, pptx
Plant Tissue culture., Plasticity, Totipotency, pptx
 
Alamkara theory by Bhamaha Indian Poetics (1).pptx
Alamkara theory by Bhamaha Indian Poetics (1).pptxAlamkara theory by Bhamaha Indian Poetics (1).pptx
Alamkara theory by Bhamaha Indian Poetics (1).pptx
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - HK2 (...
 
VIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdfVIT336 – Recommender System - Unit 3.pdf
VIT336 – Recommender System - Unit 3.pdf
 
LEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollLEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community Coll
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (FRIE...
 
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxMetabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
 
ICS2208 Lecture4 Intelligent Interface Agents.pdf
ICS2208 Lecture4 Intelligent Interface Agents.pdfICS2208 Lecture4 Intelligent Interface Agents.pdf
ICS2208 Lecture4 Intelligent Interface Agents.pdf
 

Object extraction from satellite imagery using deep learning

  • 1. Object Extraction from Satellite Imagery using Deep Learning Aly Osama
  • 2. Presenter • Aly Osama • Research Software Development Engineer at Microsoft • Contact: • Email: alyosamah@gmail.com • https://www.linkedin.com/in/alyosa ma/ • https://github.com/alyosama
  • 3. Agenda 1. Needed data, its size, 2. How training will go, 3. How evaluation should be carried, 4. What learning tools would you see and why? 5. Literature survey on the subject 6. Code sample/preliminary results
  • 4. Overview Key Words:- 1. Satellite Imagery 2. Object Extraction 3. Deep Learning 4. Python
  • 5. 1. Satellite Imagery • Objects are often very small (~20 pixels in size ) as example 0.5m/pixel • Input images are enormous (often hundreds of megapixels). • Image has more than 3 channels (RGB) called bands. • Image Format: • Images (GeoTiff , … etc ) • Labels ( GeoJSON , WTK ) • On the positive side, • The physical and pixel scale of objects are usually known in advance • There’s a low variation in observation angle.
  • 6. Datasets • SpaceNet • Source : https://aws.amazon.com/public- datasets/spacenet/ • Tutorial https://medium.com/the- downlinq/building-extraction-with-yolt2-and- spacenet-data-a926f9ffac4f • 5 Solutions: https://github.com/SpaceNetChallenge/BuildingD etectors • DSTL Satellite Imagery (Kaggle Competition ) • https://www.kaggle.com/c/dstl-satellite-imagery- feature-detection • Tutorial : https://www.kaggle.com/torrinos/dstl- satellite-imagery-feature-detection/exploration- and-plotting/run/553107 • DeepSat • UC Merced land • Satellite Websites • https://modis.gsfc.nasa.gov/ • https://sentinel.esa.int/web/sentinel/home • https://landsat.usgs.gov/
  • 7. 2. Training • Experiments 1. VGGNet. - (Baseline) • Tune the pretrained model – Transfer Learning – based on available data • Data Augmentation like • Random Crops / Scales • Color Jitter 2. Faster RCNN or YOLO • For Detection and Localization
  • 9. 3.Evaluation • Accuracy :D • Precession and Recall • Jaccard index ( Intersection over Union)
  • 10. 4. tools • Hardware • Deep Learning AMI Amazon Linux Version • https://aws.amazon.com/marketplace/pp/B01M0AXXQB • Powerful Machine with GPUs • NVIDIA GTX Titan X • Software • Caffe + Python • Pretrained models • Lasagne / Keras Framework • High level Python • Backend independent “Tensorflow or Theano” • Multi-GPU • Caffe2 ( 18-4-2017 ) • Utility • QGIS is an open-source tool for managing and editing GeoTIFFs and geoJSON files
  • 12. 5. Literature survey on the subject
  • 13. 1- A Survey on Object Detection in Optical Remote Sensing Images 2016 Gong Cheng, Junwei Han*
  • 14. Cheng et al. 2016
  • 15. Cheng et al. 2016 • Deep Learning Papers • (Han et al., 2015;Tang et al., 2015; Wang et al., 2015; Zhou et al., 2015b) • Datasets • NWPU VHR-10 dataset (Cheng et al., 2014a)1. • SZTAKI-INRIA building detection dataset (Benedek et al., 2012)2. • TAS aerial car detection dataset (Heitz and Koller, 2008)3. • Overhead imagery research dataset (OIRDS) (Tanner et al., 2009) • IITM road extraction dataset (Das et al., 2011)5.
  • 16. FAST AIRCRAFT DETECTION IN SATELLITE IMAGES BASED ON CONVOLUTIONAL NEURAL NETWORKS (Wu et. Al.) 2015
  • 17. Region Proposals TODO : Search on R-CNN
  • 18. FULLY CONVOLUTIONAL NETWORKS FOR BUILDING AND ROAD EXTRACTION: PRELIMINARY RESULTS 2016 Zilong Zhong • Dataset • Massachusetts’ road dataset and building dataset • each image consists of 3×1500×1500 pixels • contains 1,711 aerial images, • the FCN’s computation consumption could be much higher than that of the ordinary object recognition models.
  • 19. Building detection in very high resolution multispectral data with deep learning features 2016 • AlexNet -> Features + SVM ( Last layer )
  • 20. Road network extraction a neural-dynamic framework based on deep learning and a finite state machine wang2015 CNN + FSM ( for sequence )
  • 21. Do Deep Features Generalize from Everyday Objects to Remote Sensing and Aerial Scenes Domains? 2016 Ot´avio A. B. Penatti • ConvNet using Caffe and OverFeat
  • 22. Using convolutional networks and satellite imagery to identify pa.erns in urban environments at a large scale ADRIAN ALBERT*, Massachuse.s Institute of Technology2017 • Dataset : • UC Merced land use dataset [25] (of 2100 images spanning 21 classes) • DeepSat land use benchmark dataset ( 4 channels • (VGGNet and ResNet)
  • 23. 6. Code sample/prelim inary results • (Test) DSTL • https://www.kaggle.com/alyosama/dstl- satellite-imagery-feature- detection/convnet-baseline/
  • 24. YOLT2 • The actual F1 score of 0.21 • Jaccard index between 0.4 and 0.5 https://medium.com/the-downlinq/building-extraction-with-yolt2-and-spacenet-data-a926f9ffac4fT
  • 25. CosmiQNet • Blackbox Fully Convolution Neural Network: CosmiQNet. The inputs are at two resolutions and the output distance transform matches the lower of the input resolutions. The resolution of the 8-band GeoTIFF is roughly one quarter (in each dimension) the resolution of the the 3-band GeoTIFF; the difference in resolution is depicted by the scale of the GeoTIFFs. https://medium.com/the-downlinq/object-detection-on- spacenet-5e691961d257
  • 26. Resources 1. DSTL Satellite Imagery Competiton 2. https://medium.com/@avanetten 3. https://www.kernix.com/blog/image- classification-with-a-pre-trained-deep- neural-network_p11