SlideShare una empresa de Scribd logo
1 de 38
Descargar para leer sin conexión
From gigapixel timelapse cameras to unmanned aerial vehicles:
A review of emerging near remote sensing technologies for cross-scale monitoring
                           from organism to ecosystem
Limits to the rate of knowledge discovery in Ecology…
Understanding high-order complexity is hard!

1. The environment is complex and continuous but we usually
   can only measure limited data over limited snapshots in time

2. Difficult and expensive to track change on the ground at high
   spatial and temporal resolution

3. Long term data sets are rare, particularly of images
   –   Typically only satellite-based tools and data sets for long term
       ecosystem monitoring


Ecosystem science research now is like genetics used to be
   before PCR and high throughput sequencing
   (but this is changing)
The Future is arriving now
  By envisioning the future, we can bring it into being and
    shape it to meet our needs
          – What kind of hardware/software systems do we need to build?

  Imagine for any research site…
          – Live streaming access via laptop, phone, tablet
          – Multi-billion pixel resolution image feed of any study area
          – All data is archived for as long as there have been sensors

          With these tools, what kind of science and education will we do?

Capitol Reef Webcam: http://www.uvu.edu/crfs/livefeed/index.html
Conventional ecosystem monitoring
Satellite - Remote Sensing
• Macro scale / Regional
• Multi-spectral cameras
   – NDVI (Normalized Difference Vegetation Index), “Greenness”
• Image Pixel data is georeferenced to a known location
• Reliable time-series

• But:
   – Limited resolution
   – Low sample rate (daily to annually)
   – Weather dependent
Conventional ecosystem monitoring
Land based - Field-level sampling
• “Micro” scale / local
• Stand-level sampling
• Short time scales
   – Infrequent visits
   – 1 season or a few years

How to scale between ground-based sampling and
  regional-scale satellite sampling

“Near remote” Sensing – Intermediate scale
• Conventional aerial surveys (good data but expensive
  and infrequent)
• New imaging technologies can bridge the data gap
• Numeric data extraction is a challenging problem for
  image-based datasets

• Map pixels from ground-based image sources onto
  the landscape (just like satellite data)
Emerging technologies for ecosystem monitoring
•   Phenocam networks and towers
     – Plant Cams / Trail Cams
     – IP-based cameras
•   Gigapixel timelapse cameras (gigavision)
•   Unmanned Aerial Vehicles (UAV/UAS’s)
•   Kite & balloon photography
     –   http://www.geospectra.net/kite/equip/camera_rigs.htm
     –   http://www.grassrootsmapping.org

•   Socially networked science / Citizen Science
     – Smartphone applications and geotagged images
Other enabling technologies
•   Wireless Internet
     – Satellite Internet
     – 802.11 wireless
     – Cellular: A 4G cell phone has about the same bandwidth as
       MODIS (and more processing power)

•   Wireless microclimate sensor arrays
•   Google Earth
Near remote sensing: “Phenocam” Towers
• Work well, particularly when coupled with ground-based
  sensor systems.
• Enable capture of visible & infrared images of research areas
   – Ground-truth satellite data
• But limited sampling area: FOV < 150m2
Rio Mesa sensor systems

• 30’ towers
• Solar powered
• 5 megapixel network
  cameras
• Infrared cameras (NDVI)
• Satellite images
• Weather station
• Tamarisk & cottonwood
  sap flux
• Wireless network
   – 802.11  Satellite Internet
From gigapixel timelapse cameras to unmanned aerial vehicles to smartphones: a review of emerging near remote sensing technologies for scaling from organism to ecosystem
Camera Systems
Tamarisk year timelapse in Vis and IR: http://www.youtube.com/watch?v=Wd4PBEmHU2o&hd=1
Rio Mesa “Gauge Site” - Results




                  NDVI



        Tamarisk NDVI measured from tower based Infrared cameras at Rio Mesa Field Station, 2008-2009. [Nagler, Brown, Hultine, et al, in prep]
Beetle Arrives




            Sap Flux
Online data visualization tools




http://riomesa-data.biology.utah.edu/station.aspx
http://riomesa-data.biology.utah.edu/station.aspx?id=ws1&ubm=74
Gigavision: gigapixel timelapse camera
Multi-billion pixel imaging system
    – Pan/Tilt camera system
    – Resolution of 1 pixel / cm over 7 hectares
        • (~600 million times the resolution of MODIS)
    – Monitor every individual plant within large area
    – Embed into Google Earth (should be pixel mapped)
    – Timelapse record of phenology & long term
      ecosystem change
Camera Specifications
   – Cellular (3G) or 802.11g wireless access
   – Automated capture up to 1 image / hr
   – 180 - 360° degree view
   – Power consumption: ~12w
   – Solar powered
From gigapixel timelapse cameras to unmanned aerial vehicles to smartphones: a review of emerging near remote sensing technologies for scaling from organism to ecosystem
Image Visualization and Data Collection




                            http://www.gigavision.org
Area: 6-7 ha




               http://www.youtube.com/watch?
               v=-_vzxzpJVjc&hd=1
From gigapixel timelapse cameras to unmanned aerial vehicles to smartphones: a review of emerging near remote sensing technologies for scaling from organism to ecosystem
Unmanned Aerial Vehicles (UAVs) for Ecosystem Monitoring
•    GPS Autopilot can repeat sampling with +/- 3m accuracy
•    Flies @ 400’; 30-40 mph
•    Survey 1 km2 area in < 10 minutes @ 5 pixels /cm
•    12 Megapixel consumer camera + 3MP Infrared Vegetation Camera (NDVI)
•    Each 12mp image covers 274x366 m2 area [MODIS = 1 pixel / 250x250 m2]
•    Resolution = ~100 pixels/m2
•    Commercial version:
      – $9,000 - $23,000, hardware (Total cost with training, software, etc: $30,000-$50,000)
•    DIY version: < $1,000 (http://www.DIYdrones.com)
•    In the long term: Automated high resolution aerial imagery at long term sites like NEON
•    Main current challenge is regulatory




                       RP Flight Systems                                   http://www.mikrokopter.us/
76 image
panorama
From gigapixel timelapse cameras to unmanned aerial vehicles to smartphones: a review of emerging near remote sensing technologies for scaling from organism to ecosystem
QuadroCopter Video: http://www.youtube.com/watch?v=L1rQJ7cjfuA&hd=1
High Altitude “Satellite Replacement” systems

NASA Helios project
• Prototype long endurance solar powered aircraft
• Flies at 15,000 – 22,000m
• 6 months flight time (solar + hydrogen cells)
• 200 lb payload




                http://www.nasa.gov/centers/dryden/news/FactSheets/FS-068-DFRC.html
Kite / Balloon Aerial Photography




                                    Grassrootsmapping.org
Kite / Balloon Aerial Photography




~40 image panorama of Chandeleur Island, LA, taken from a balloon




                                                        Grassrootsmapping.org
3D track of the balloon in the air




High resolution image layer from balloon’s images, in Google Earth
Other tools for data collection
Gigapan
•   Low cost pan-tilt head for gigapixel repeat photography
•   http://www.gigapan.org
•   Repeat photography
•   Embed in Google Earth
•   Example: Early detection of bark beetle infestations at Alta Ski area, Alta, UT
•   See also: http://www.xrez.com/yose_proj/yose_deepzoom/index.html for an amazing example
    (72 gigapans shot on the same day to build a pixel-accurate 3D model of Yosemite)

Game cameras / Plant cams
    – Wingscapes plant / birdcams – http://www.wingscapes.com
    – Buckeye game cameras -- http://www.buckeyecam.com/
    – $300 with solar panel
    – Smithsonian game camera projects website: http://siwild.si.edu/

Canon CHDK
     – Convert a $50-$100 Canon into a 8MP timelapse camera
     – http://chdk.wikia.com/

Low cost GPS
•   Eye-fi SD card
     – Add GPS/WiFi capabilities to any camera
     – http://www.eye.fi/

•   GPS loggers
     – $100 / Many brands, search amazon for “gps logger”

•   iPhone / Android apps
      – EveryTrail – http://www.everytrail.com
Citizen Science
• Picture Post
   – http://picturepost.unh.edu/


• Smartphone apps (See OOS22 session, Wed AM)
   – Virtual picture post
   – Panorama software (try the “360panorama” app for iPhone)
   – Phenology apps:
      • PhenoMap; BudBurst; others
• Geo-tagged photos
   – Flickr: ~4 million images geotagged per month
       • 6 billion photos, 156 million are geotagged (Aug 2011)
   – Facebook:
       • 2.5 billion images uploaded / month
   – National Parks – 280 million visitors / yr
       (http://www.nature.nps.gov/socialscience/stats.cfm)
From gigapixel timelapse cameras to unmanned aerial vehicles to smartphones: a review of emerging near remote sensing technologies for scaling from organism to ecosystem
Geotagged Chicago




© Eric Fischer (http://www.flickr.com/photos/walkingsf/ )
Photosynth




Microsoft and U. Washington PhotoTourism and Photosynth projects
    – http://grail.cs.washington.edu/projects/rome/
    – http://phototour.cs.washington.edu/findingpaths/
    – http://photosynth.net/
Creating a 3D map of Dubrovnik with 3.5 million flickr photos:
http://www.youtube.com/watch?v=sQegEro5Bfo&hd=1
Ecology’s PCR moment is coming…
•   Computers, hard drives and all technologies are getting faster, smaller and cheaper

•   New monitoring tools
     –   Exponentially increase rates of data collection

•   Wireless technologies
     –   Live data streams

•   Long term data collection projects (NEON, LTER, etc.)
     –   Large, long-term standardized data sets
     –   DataONE

•   Internet based data sharing
     –   Collaborative, open-source science
     –   Multi-disciplinary research
     –   Increases in level of complexity that can be examined
     –   Enhanced science education

•   Crowd-sourcing / Citizen science
     –   Improved public education
     –   Improved citizen engagement
     –   Improved landscape monitoring
     –   Increase rate of data collection and knowledge discovery

•   Improved programming and visualization tools
     –   Larger data sets
     –   Enhanced visualization and data management tools
     –   Automated data processing
     –   Easy to use analysis tools
The seasons of flickr
•   http://hint.fm/projects/flickr/
Links and Credits
More Info
• Gigavision Gigapixel camera project: http://Gigavision.org
• TimeScience: http://www.time-science.com
• Interactive online data visualization: http://riomesa-data.biology.utah.edu/
• Gigapan pan/tilt camera head: http://Gigapan.org Search TimeScience
• Kite photography: http://grassrootsmapping.org
• Online mapping/image warping tool: http://Cartgen.org
• Hyperblimp: http://www.hyperblimp.com/
• DIY Drones: http://diydrones.com/

Credit and thanks to
• Programming and project support:
    – Christopher Zimmermann, TimeScience

•   USGS Tamarisk survey project:
     – Pamela Nagler, USGS
     – Kevin Hultine, University of Utah / N. Arizona University

•   Gigavision Project:
     – Justin Borevitz, University of Chicago
CONTACTS
Camera System design and Data Visualization Tools
  Tim Brown
  TimeScience
  tim@time-science.com
  801.554.9296
  http://www.time-science.com

Gigavision Camera Project / High Throughput Phenotyping
   Justin Borevitz
   University of Chicago / Australian National University
   borevitz@uchicago.edu

Tamarisk Sap Flux and Research Projects
  Pamela Nagler
  USGS, Sonoran Desert Research Station, Tucson, AZ
  pnagler@usgs.gov

   Kevin Hultine
   Desert Botanical Garden, Phoenix, AZ
   Kevin.Hultine@nau.edu
• Gigapixel Yosemite
   – http://www.xrez.com/yose_proj/yose_deepzoom/index.html

Más contenido relacionado

La actualidad más candente

2015 05 Scaling from seeds to ecosystems
2015 05 Scaling from seeds to ecosystems2015 05 Scaling from seeds to ecosystems
2015 05 Scaling from seeds to ecosystemsTimeScience
 
Lec_13_Introduction to Remote Sensing (RS)
Lec_13_Introduction to Remote Sensing (RS)Lec_13_Introduction to Remote Sensing (RS)
Lec_13_Introduction to Remote Sensing (RS)Atiqa khan
 
Remote sensing concept and applications
Remote sensing   concept and applicationsRemote sensing   concept and applications
Remote sensing concept and applicationsMegha Majoe
 
remote sensing
remote sensingremote sensing
remote sensing78harshith
 
Remote sensing and its applications in environment
Remote sensing and its applications in environmentRemote sensing and its applications in environment
Remote sensing and its applications in environmentMuhammad Sajjad
 
DRI Energy Related Projects
DRI Energy Related ProjectsDRI Energy Related Projects
DRI Energy Related ProjectsDRIscience
 
Remote sensing by priyanshu kumar,9608684800
Remote sensing by priyanshu kumar,9608684800Remote sensing by priyanshu kumar,9608684800
Remote sensing by priyanshu kumar,9608684800PRIYANSHU KUMAR
 
Usages and Challenges of using DRONES in Reconstruction Efforts of NEPAL
Usages and Challenges of using DRONES  in Reconstruction Efforts of NEPALUsages and Challenges of using DRONES  in Reconstruction Efforts of NEPAL
Usages and Challenges of using DRONES in Reconstruction Efforts of NEPALNepal Flying Labs
 
Remote Sensing PPT
Remote Sensing PPTRemote Sensing PPT
Remote Sensing PPTAmal Murali
 
AEG Presentation
AEG PresentationAEG Presentation
AEG PresentationJosh Wagner
 
Intelligent satellites
Intelligent satellitesIntelligent satellites
Intelligent satellitesClifford Stone
 
Indian remote sensing satellite mission
Indian remote sensing satellite missionIndian remote sensing satellite mission
Indian remote sensing satellite missionadevekar
 
How can drone data be used in modelling?
How can drone data be used in modelling?How can drone data be used in modelling?
How can drone data be used in modelling?ARDC
 
TraitCapture: NextGen phenomics tools for lab and field [ComBio2015]
TraitCapture: NextGen phenomics tools for lab and field [ComBio2015]TraitCapture: NextGen phenomics tools for lab and field [ComBio2015]
TraitCapture: NextGen phenomics tools for lab and field [ComBio2015]TimeScience
 
Estlin aegissoyajpl 2012
Estlin aegissoyajpl 2012Estlin aegissoyajpl 2012
Estlin aegissoyajpl 2012NASAPMC
 
Ppt on remote sensing system
Ppt on remote sensing systemPpt on remote sensing system
Ppt on remote sensing systemAlisha Korpal
 

La actualidad más candente (20)

2015 05 Scaling from seeds to ecosystems
2015 05 Scaling from seeds to ecosystems2015 05 Scaling from seeds to ecosystems
2015 05 Scaling from seeds to ecosystems
 
Lec_13_Introduction to Remote Sensing (RS)
Lec_13_Introduction to Remote Sensing (RS)Lec_13_Introduction to Remote Sensing (RS)
Lec_13_Introduction to Remote Sensing (RS)
 
Remote sensing concept and applications
Remote sensing   concept and applicationsRemote sensing   concept and applications
Remote sensing concept and applications
 
remote sensing
remote sensingremote sensing
remote sensing
 
Remote sensing and its applications in environment
Remote sensing and its applications in environmentRemote sensing and its applications in environment
Remote sensing and its applications in environment
 
DRI Energy Related Projects
DRI Energy Related ProjectsDRI Energy Related Projects
DRI Energy Related Projects
 
Remote+Sensing
Remote+SensingRemote+Sensing
Remote+Sensing
 
Remote sensing by priyanshu kumar,9608684800
Remote sensing by priyanshu kumar,9608684800Remote sensing by priyanshu kumar,9608684800
Remote sensing by priyanshu kumar,9608684800
 
Usages and Challenges of using DRONES in Reconstruction Efforts of NEPAL
Usages and Challenges of using DRONES  in Reconstruction Efforts of NEPALUsages and Challenges of using DRONES  in Reconstruction Efforts of NEPAL
Usages and Challenges of using DRONES in Reconstruction Efforts of NEPAL
 
Remote Sensing PPT
Remote Sensing PPTRemote Sensing PPT
Remote Sensing PPT
 
AEG Presentation
AEG PresentationAEG Presentation
AEG Presentation
 
Intelligent satellites
Intelligent satellitesIntelligent satellites
Intelligent satellites
 
Indian remote sensing satellite mission
Indian remote sensing satellite missionIndian remote sensing satellite mission
Indian remote sensing satellite mission
 
Remote Sensing ppt
Remote Sensing pptRemote Sensing ppt
Remote Sensing ppt
 
Remote Sensing of Aerosols
Remote Sensing of AerosolsRemote Sensing of Aerosols
Remote Sensing of Aerosols
 
How can drone data be used in modelling?
How can drone data be used in modelling?How can drone data be used in modelling?
How can drone data be used in modelling?
 
TraitCapture: NextGen phenomics tools for lab and field [ComBio2015]
TraitCapture: NextGen phenomics tools for lab and field [ComBio2015]TraitCapture: NextGen phenomics tools for lab and field [ComBio2015]
TraitCapture: NextGen phenomics tools for lab and field [ComBio2015]
 
Remote sensing
Remote sensingRemote sensing
Remote sensing
 
Estlin aegissoyajpl 2012
Estlin aegissoyajpl 2012Estlin aegissoyajpl 2012
Estlin aegissoyajpl 2012
 
Ppt on remote sensing system
Ppt on remote sensing systemPpt on remote sensing system
Ppt on remote sensing system
 

Similar a From gigapixel timelapse cameras to unmanned aerial vehicles to smartphones: a review of emerging near remote sensing technologies for scaling from organism to ecosystem

NextGen environmental sensing at the National Arboretum
NextGen environmental sensing at the National ArboretumNextGen environmental sensing at the National Arboretum
NextGen environmental sensing at the National ArboretumTimeScience
 
From pixels to point clouds - Using drones,game engines and virtual reality t...
From pixels to point clouds - Using drones,game engines and virtual reality t...From pixels to point clouds - Using drones,game engines and virtual reality t...
From pixels to point clouds - Using drones,game engines and virtual reality t...ARDC
 
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystemTraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystemTimeScience
 
Gigapixel imaging, ESA Australia, Dec 2012
Gigapixel imaging, ESA Australia, Dec 2012Gigapixel imaging, ESA Australia, Dec 2012
Gigapixel imaging, ESA Australia, Dec 2012TimeScience
 
Capturing the unseen from above: uavs as platforms for imaging techniques
Capturing the unseen from above: uavs as platforms for imaging techniquesCapturing the unseen from above: uavs as platforms for imaging techniques
Capturing the unseen from above: uavs as platforms for imaging techniquesVisual Resources Association
 
Applying Photonics to User Needs: The Application Challenge
Applying Photonics to User Needs: The Application ChallengeApplying Photonics to User Needs: The Application Challenge
Applying Photonics to User Needs: The Application ChallengeLarry Smarr
 
The Pacific Research Platform: A Science-Driven Big-Data Freeway System
The Pacific Research Platform: A Science-Driven Big-Data Freeway SystemThe Pacific Research Platform: A Science-Driven Big-Data Freeway System
The Pacific Research Platform: A Science-Driven Big-Data Freeway SystemLarry Smarr
 
Geocom venture lab002
Geocom venture lab002Geocom venture lab002
Geocom venture lab002Ed Villegas
 
One GeoNode, many GeoNodes
One GeoNode, many GeoNodesOne GeoNode, many GeoNodes
One GeoNode, many GeoNodesGeoSolutions
 
The Future of Technology in Stormwater: Drones to Augmented Reality
The Future of Technology in Stormwater: Drones to Augmented RealityThe Future of Technology in Stormwater: Drones to Augmented Reality
The Future of Technology in Stormwater: Drones to Augmented RealityMapistry
 
Strata Hadoop Talk 2016 August
Strata Hadoop Talk 2016 AugustStrata Hadoop Talk 2016 August
Strata Hadoop Talk 2016 AugustClaire Fang
 
The Pacific Research Platform: A Science-Driven Big-Data Freeway System
The Pacific Research Platform: A Science-Driven Big-Data Freeway SystemThe Pacific Research Platform: A Science-Driven Big-Data Freeway System
The Pacific Research Platform: A Science-Driven Big-Data Freeway SystemLarry Smarr
 
The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...
The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...
The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...Larry Smarr
 
TraitCapture:Open source tools for DIY high throughput Phenomics and NextGen ...
TraitCapture:Open source tools for DIY high throughput Phenomics and NextGen ...TraitCapture:Open source tools for DIY high throughput Phenomics and NextGen ...
TraitCapture:Open source tools for DIY high throughput Phenomics and NextGen ...TimeScience
 
The Pacific Research Platform
The Pacific Research PlatformThe Pacific Research Platform
The Pacific Research PlatformLarry Smarr
 
Drones on the Coast
Drones on the Coast Drones on the Coast
Drones on the Coast ARDC
 
Data analytics space final
Data analytics  space finalData analytics  space final
Data analytics space finalM S Prasad
 
Data Management and Applications at SOCIB
Data Management and Applications at SOCIBData Management and Applications at SOCIB
Data Management and Applications at SOCIBDavid March
 

Similar a From gigapixel timelapse cameras to unmanned aerial vehicles to smartphones: a review of emerging near remote sensing technologies for scaling from organism to ecosystem (20)

NextGen environmental sensing at the National Arboretum
NextGen environmental sensing at the National ArboretumNextGen environmental sensing at the National Arboretum
NextGen environmental sensing at the National Arboretum
 
From pixels to point clouds - Using drones,game engines and virtual reality t...
From pixels to point clouds - Using drones,game engines and virtual reality t...From pixels to point clouds - Using drones,game engines and virtual reality t...
From pixels to point clouds - Using drones,game engines and virtual reality t...
 
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystemTraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
 
Gigapixel imaging, ESA Australia, Dec 2012
Gigapixel imaging, ESA Australia, Dec 2012Gigapixel imaging, ESA Australia, Dec 2012
Gigapixel imaging, ESA Australia, Dec 2012
 
Capturing the unseen from above: uavs as platforms for imaging techniques
Capturing the unseen from above: uavs as platforms for imaging techniquesCapturing the unseen from above: uavs as platforms for imaging techniques
Capturing the unseen from above: uavs as platforms for imaging techniques
 
Applying Photonics to User Needs: The Application Challenge
Applying Photonics to User Needs: The Application ChallengeApplying Photonics to User Needs: The Application Challenge
Applying Photonics to User Needs: The Application Challenge
 
The Pacific Research Platform: A Science-Driven Big-Data Freeway System
The Pacific Research Platform: A Science-Driven Big-Data Freeway SystemThe Pacific Research Platform: A Science-Driven Big-Data Freeway System
The Pacific Research Platform: A Science-Driven Big-Data Freeway System
 
Geocom venture lab002
Geocom venture lab002Geocom venture lab002
Geocom venture lab002
 
One GeoNode, many GeoNodes
One GeoNode, many GeoNodesOne GeoNode, many GeoNodes
One GeoNode, many GeoNodes
 
The Future of Technology in Stormwater: Drones to Augmented Reality
The Future of Technology in Stormwater: Drones to Augmented RealityThe Future of Technology in Stormwater: Drones to Augmented Reality
The Future of Technology in Stormwater: Drones to Augmented Reality
 
Strata Hadoop Talk 2016 August
Strata Hadoop Talk 2016 AugustStrata Hadoop Talk 2016 August
Strata Hadoop Talk 2016 August
 
Assessing soil erosion with unmanned aeria vehicles
Assessing soil erosion with unmanned aeria vehiclesAssessing soil erosion with unmanned aeria vehicles
Assessing soil erosion with unmanned aeria vehicles
 
The Pacific Research Platform: A Science-Driven Big-Data Freeway System
The Pacific Research Platform: A Science-Driven Big-Data Freeway SystemThe Pacific Research Platform: A Science-Driven Big-Data Freeway System
The Pacific Research Platform: A Science-Driven Big-Data Freeway System
 
The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...
The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...
The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...
 
TraitCapture:Open source tools for DIY high throughput Phenomics and NextGen ...
TraitCapture:Open source tools for DIY high throughput Phenomics and NextGen ...TraitCapture:Open source tools for DIY high throughput Phenomics and NextGen ...
TraitCapture:Open source tools for DIY high throughput Phenomics and NextGen ...
 
The Pacific Research Platform
The Pacific Research PlatformThe Pacific Research Platform
The Pacific Research Platform
 
Drones on the Coast
Drones on the Coast Drones on the Coast
Drones on the Coast
 
stuart_2015_v2.0
stuart_2015_v2.0stuart_2015_v2.0
stuart_2015_v2.0
 
Data analytics space final
Data analytics  space finalData analytics  space final
Data analytics space final
 
Data Management and Applications at SOCIB
Data Management and Applications at SOCIBData Management and Applications at SOCIB
Data Management and Applications at SOCIB
 

Último

Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceMartin Humpolec
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 

Último (20)

Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your Salesforce
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 

From gigapixel timelapse cameras to unmanned aerial vehicles to smartphones: a review of emerging near remote sensing technologies for scaling from organism to ecosystem

  • 1. From gigapixel timelapse cameras to unmanned aerial vehicles: A review of emerging near remote sensing technologies for cross-scale monitoring from organism to ecosystem
  • 2. Limits to the rate of knowledge discovery in Ecology… Understanding high-order complexity is hard! 1. The environment is complex and continuous but we usually can only measure limited data over limited snapshots in time 2. Difficult and expensive to track change on the ground at high spatial and temporal resolution 3. Long term data sets are rare, particularly of images – Typically only satellite-based tools and data sets for long term ecosystem monitoring Ecosystem science research now is like genetics used to be before PCR and high throughput sequencing (but this is changing)
  • 3. The Future is arriving now By envisioning the future, we can bring it into being and shape it to meet our needs – What kind of hardware/software systems do we need to build? Imagine for any research site… – Live streaming access via laptop, phone, tablet – Multi-billion pixel resolution image feed of any study area – All data is archived for as long as there have been sensors With these tools, what kind of science and education will we do? Capitol Reef Webcam: http://www.uvu.edu/crfs/livefeed/index.html
  • 4. Conventional ecosystem monitoring Satellite - Remote Sensing • Macro scale / Regional • Multi-spectral cameras – NDVI (Normalized Difference Vegetation Index), “Greenness” • Image Pixel data is georeferenced to a known location • Reliable time-series • But: – Limited resolution – Low sample rate (daily to annually) – Weather dependent
  • 5. Conventional ecosystem monitoring Land based - Field-level sampling • “Micro” scale / local • Stand-level sampling • Short time scales – Infrequent visits – 1 season or a few years How to scale between ground-based sampling and regional-scale satellite sampling “Near remote” Sensing – Intermediate scale • Conventional aerial surveys (good data but expensive and infrequent) • New imaging technologies can bridge the data gap
  • 6. • Numeric data extraction is a challenging problem for image-based datasets • Map pixels from ground-based image sources onto the landscape (just like satellite data)
  • 7. Emerging technologies for ecosystem monitoring • Phenocam networks and towers – Plant Cams / Trail Cams – IP-based cameras • Gigapixel timelapse cameras (gigavision) • Unmanned Aerial Vehicles (UAV/UAS’s) • Kite & balloon photography – http://www.geospectra.net/kite/equip/camera_rigs.htm – http://www.grassrootsmapping.org • Socially networked science / Citizen Science – Smartphone applications and geotagged images Other enabling technologies • Wireless Internet – Satellite Internet – 802.11 wireless – Cellular: A 4G cell phone has about the same bandwidth as MODIS (and more processing power) • Wireless microclimate sensor arrays • Google Earth
  • 8. Near remote sensing: “Phenocam” Towers • Work well, particularly when coupled with ground-based sensor systems. • Enable capture of visible & infrared images of research areas – Ground-truth satellite data • But limited sampling area: FOV < 150m2
  • 9. Rio Mesa sensor systems • 30’ towers • Solar powered • 5 megapixel network cameras • Infrared cameras (NDVI) • Satellite images • Weather station • Tamarisk & cottonwood sap flux • Wireless network – 802.11  Satellite Internet
  • 12. Tamarisk year timelapse in Vis and IR: http://www.youtube.com/watch?v=Wd4PBEmHU2o&hd=1
  • 13. Rio Mesa “Gauge Site” - Results NDVI Tamarisk NDVI measured from tower based Infrared cameras at Rio Mesa Field Station, 2008-2009. [Nagler, Brown, Hultine, et al, in prep] Beetle Arrives Sap Flux
  • 14. Online data visualization tools http://riomesa-data.biology.utah.edu/station.aspx http://riomesa-data.biology.utah.edu/station.aspx?id=ws1&ubm=74
  • 15. Gigavision: gigapixel timelapse camera Multi-billion pixel imaging system – Pan/Tilt camera system – Resolution of 1 pixel / cm over 7 hectares • (~600 million times the resolution of MODIS) – Monitor every individual plant within large area – Embed into Google Earth (should be pixel mapped) – Timelapse record of phenology & long term ecosystem change Camera Specifications – Cellular (3G) or 802.11g wireless access – Automated capture up to 1 image / hr – 180 - 360° degree view – Power consumption: ~12w – Solar powered
  • 17. Image Visualization and Data Collection http://www.gigavision.org
  • 18. Area: 6-7 ha http://www.youtube.com/watch? v=-_vzxzpJVjc&hd=1
  • 20. Unmanned Aerial Vehicles (UAVs) for Ecosystem Monitoring • GPS Autopilot can repeat sampling with +/- 3m accuracy • Flies @ 400’; 30-40 mph • Survey 1 km2 area in < 10 minutes @ 5 pixels /cm • 12 Megapixel consumer camera + 3MP Infrared Vegetation Camera (NDVI) • Each 12mp image covers 274x366 m2 area [MODIS = 1 pixel / 250x250 m2] • Resolution = ~100 pixels/m2 • Commercial version: – $9,000 - $23,000, hardware (Total cost with training, software, etc: $30,000-$50,000) • DIY version: < $1,000 (http://www.DIYdrones.com) • In the long term: Automated high resolution aerial imagery at long term sites like NEON • Main current challenge is regulatory RP Flight Systems http://www.mikrokopter.us/
  • 24. High Altitude “Satellite Replacement” systems NASA Helios project • Prototype long endurance solar powered aircraft • Flies at 15,000 – 22,000m • 6 months flight time (solar + hydrogen cells) • 200 lb payload http://www.nasa.gov/centers/dryden/news/FactSheets/FS-068-DFRC.html
  • 25. Kite / Balloon Aerial Photography Grassrootsmapping.org
  • 26. Kite / Balloon Aerial Photography ~40 image panorama of Chandeleur Island, LA, taken from a balloon Grassrootsmapping.org
  • 27. 3D track of the balloon in the air High resolution image layer from balloon’s images, in Google Earth
  • 28. Other tools for data collection Gigapan • Low cost pan-tilt head for gigapixel repeat photography • http://www.gigapan.org • Repeat photography • Embed in Google Earth • Example: Early detection of bark beetle infestations at Alta Ski area, Alta, UT • See also: http://www.xrez.com/yose_proj/yose_deepzoom/index.html for an amazing example (72 gigapans shot on the same day to build a pixel-accurate 3D model of Yosemite) Game cameras / Plant cams – Wingscapes plant / birdcams – http://www.wingscapes.com – Buckeye game cameras -- http://www.buckeyecam.com/ – $300 with solar panel – Smithsonian game camera projects website: http://siwild.si.edu/ Canon CHDK – Convert a $50-$100 Canon into a 8MP timelapse camera – http://chdk.wikia.com/ Low cost GPS • Eye-fi SD card – Add GPS/WiFi capabilities to any camera – http://www.eye.fi/ • GPS loggers – $100 / Many brands, search amazon for “gps logger” • iPhone / Android apps – EveryTrail – http://www.everytrail.com
  • 29. Citizen Science • Picture Post – http://picturepost.unh.edu/ • Smartphone apps (See OOS22 session, Wed AM) – Virtual picture post – Panorama software (try the “360panorama” app for iPhone) – Phenology apps: • PhenoMap; BudBurst; others • Geo-tagged photos – Flickr: ~4 million images geotagged per month • 6 billion photos, 156 million are geotagged (Aug 2011) – Facebook: • 2.5 billion images uploaded / month – National Parks – 280 million visitors / yr (http://www.nature.nps.gov/socialscience/stats.cfm)
  • 31. Geotagged Chicago © Eric Fischer (http://www.flickr.com/photos/walkingsf/ )
  • 32. Photosynth Microsoft and U. Washington PhotoTourism and Photosynth projects – http://grail.cs.washington.edu/projects/rome/ – http://phototour.cs.washington.edu/findingpaths/ – http://photosynth.net/
  • 33. Creating a 3D map of Dubrovnik with 3.5 million flickr photos: http://www.youtube.com/watch?v=sQegEro5Bfo&hd=1
  • 34. Ecology’s PCR moment is coming… • Computers, hard drives and all technologies are getting faster, smaller and cheaper • New monitoring tools – Exponentially increase rates of data collection • Wireless technologies – Live data streams • Long term data collection projects (NEON, LTER, etc.) – Large, long-term standardized data sets – DataONE • Internet based data sharing – Collaborative, open-source science – Multi-disciplinary research – Increases in level of complexity that can be examined – Enhanced science education • Crowd-sourcing / Citizen science – Improved public education – Improved citizen engagement – Improved landscape monitoring – Increase rate of data collection and knowledge discovery • Improved programming and visualization tools – Larger data sets – Enhanced visualization and data management tools – Automated data processing – Easy to use analysis tools
  • 35. The seasons of flickr • http://hint.fm/projects/flickr/
  • 36. Links and Credits More Info • Gigavision Gigapixel camera project: http://Gigavision.org • TimeScience: http://www.time-science.com • Interactive online data visualization: http://riomesa-data.biology.utah.edu/ • Gigapan pan/tilt camera head: http://Gigapan.org Search TimeScience • Kite photography: http://grassrootsmapping.org • Online mapping/image warping tool: http://Cartgen.org • Hyperblimp: http://www.hyperblimp.com/ • DIY Drones: http://diydrones.com/ Credit and thanks to • Programming and project support: – Christopher Zimmermann, TimeScience • USGS Tamarisk survey project: – Pamela Nagler, USGS – Kevin Hultine, University of Utah / N. Arizona University • Gigavision Project: – Justin Borevitz, University of Chicago
  • 37. CONTACTS Camera System design and Data Visualization Tools Tim Brown TimeScience tim@time-science.com 801.554.9296 http://www.time-science.com Gigavision Camera Project / High Throughput Phenotyping Justin Borevitz University of Chicago / Australian National University borevitz@uchicago.edu Tamarisk Sap Flux and Research Projects Pamela Nagler USGS, Sonoran Desert Research Station, Tucson, AZ pnagler@usgs.gov Kevin Hultine Desert Botanical Garden, Phoenix, AZ Kevin.Hultine@nau.edu
  • 38. • Gigapixel Yosemite – http://www.xrez.com/yose_proj/yose_deepzoom/index.html