Latest Developments in Oceanographic Applications of GIS, including Near-real-time Interactive Map Exemplars and Scientific Empowerment through Storytelling,
•Descargar como PPTX, PDF•
1 recomendación•205 vistas
Invited presentation for Schmidt Ocean Institute Research Planning Workshop on Transforming Seagoing Science with Robotic Platforms, Innovative Software Engineering, and Data Analytics, August 2015
Recomendados
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Similar a Latest Developments in Oceanographic Applications of GIS, including Near-real-time Interactive Map Exemplars and Scientific Empowerment through Storytelling,
Similar a Latest Developments in Oceanographic Applications of GIS, including Near-real-time Interactive Map Exemplars and Scientific Empowerment through Storytelling, (20)
Más de Dawn Wright
Más de Dawn Wright (20)
Último
Último (20)
Latest Developments in Oceanographic Applications of GIS, including Near-real-time Interactive Map Exemplars and Scientific Empowerment through Storytelling,
- 1. Latest Developments in Oceanographic Applications of GIS including … Dawn Wright Esri Chief Scientist Affiliate Professor, Oregon State U. Near-Real-Time Interactive Map Exemplars & Scientific Empowerment Through Storytelling Schmidt Ocean Institute Research Planning Workshop, August 26, 2015
- 4. Analytics….
- 5. DesktopWeb Device GeoEvent Extension GeoAnalytics Extension A ArcGIS Server Ingestion Visualization Analytics ArcGIS Spatiotemporal Big Data Store Storage High velocity and volume spatiotemporal data Stream Layer Stream Service Web & Real-Time GIS • Integration, analysis of high- velocity & -volume data • Updates, alerts sent out
- 6. Types of (Geo)Analytics Aggregate by Polygons or Cells
- 7. http://blogs.esri.com/esri/apl/2015/03/11/dimension-explorer/ Dimension Explorer Add-In (Desktop)
- 8. Simple Integration Out of the Box Interoperability / Crosswalking
- 11. DesktopWeb Device GeoEvent Extension GeoAnalytics Extension A ArcGIS Server Ingestion Visualization Analytics ArcGIS Spatiotemporal Big Data Store Storage High velocity and volume spatiotemporal data Stream Layer Stream Service Web & Real-Time GIS
- 12. Dashboards…
- 14. Shin Kobara, Texas A&M Wave Glider Sensor Dashboard: bit.ly/gcooswaveglider From Kobara et al., 2015, Ocean Solutions, Earth Solutions
- 15. Shin Kobara, Texas A&M Esri Global Fishing Watch aimed at Illegal, Unreported, Unregulated Fishing Active Vessels Dashboard Prototype
- 16. Cool Maps….
- 22. arcg.is/1Pg7Jlg
- 24. Once upon a time…
- 25. “Stories are data with a soul, …persuasive and memorable.” – Nancy Baron, Director of Science Outreach, COMPASS
- 26. By Charles Saxon | Published March 21, 1983 Licensed personally to Dawn Wright by The New Yorker Cartoon Bank, TCB-86966, Invoice L12480
- 30. Sensor dashboard as a story map
- 37. Natural Resources Defense Council, esriurl.com/ocnstories
- 38. Natural Resources Defense Council, esriurl.com/ocnstories
- 39. Natural Resources Defense Council, esriurl.com/ocnstories
- 40. esriurl.com/scicomm, esriurl.com/ocnstories, esriurl.com/ocnres Final Chapter Consider implications for education, training, certification? Consider potential of stories and scientific storytelling via maps, photos, videos, more Consider implications for ocean science contributions to society Dawn Wright dwright@esri.com @deepseadawn
- 41. Extra Slides
- 43. Background Supporting Details Result COMPASS, 2011 Policy Makers A Result A Public Good So What? Supporting Info. Scientists / Resource Managers
- 46. Story map made into a conference poster with interactive version on table for discussion &questions, e.g., esriurl.com/agustories
- 48. How do I get real-time data into a GIS? ArcGIS example: Use an Input Connector You can create your own connectors. GeoEvent Extension Inputs Outputs GeoEvent Services Poll an ArcGIS Server for Features Poll an external website for GeoJSON, JSON, or XML Features, GeoJSON, JSON, or XML on a REST endpoint Receive RSS Receive GeoJSON or JSON on a WebSocket Receive Text from a TCP or UDP Socket Subscribe to external WebSocket for GeoJSON or JSON Watch a Folder for new CSV, GeoJSON, or JSON Files EsriOutoftheBox REST .csv WS WS HTTP EsriGallery ActiveMQ CAP Instagram Flume Cursor-on-Target RabbitMQ NMEA 0183 MQTT Sierra Wireless (RAP) KML Kafka * Trimble (TAIP) Twitter PartnerGallery CompassLDE enviroCar GNIP FAA (ASDI) exactEarth AIS Zonar Valarm Networkfleet OSIsoft * * * * * * *
- 49. Applying Real-Time Analytics ArcGIS example: Use a GeoEvent Processor You can create your own processors. GeoEvent Extension Inputs Outputs GeoEvent Services Aggregator Buffer Creator Convex Hull Creator Difference Creator Envelope Creator Field Calculator Field Enricher Geotagger Incident Detector Intersector Projector Simplifier Sliding Time Window Symmetric Difference Field Mapper Track Gap Detector EsriOutoftheBox Add XYZ EsriGallery Bearing Ellipse Event Volume Control Extent Enricher Field Grouper GeoNames Lookup Range Fan Reverse Geocoder Service Area Creator Symbol Lookup Track Idle Detector Unit Converter Visibility Motion Calculator Query Report Field Reducer Union Creator * *
- 50. How do I update and alert those who need it where they need it? Disseminate notifications, alerts, and updates using an Output Connector You can create your own connectors. GeoEvent Extension Inputs Outputs GeoEvent Services EsriOutoftheBox Add or Update a feature Publish Text to a UDP Socket Send a Text Message Send an Email Push Text to an external TCP Socket Push GeoJSON or JSON to an external WebSocket Push GeoJSON or JSON to an external Website Send an Instant Message Send Features to a Stream Service Write to a CSV, GeoJSON, or JSON File.csv WS im HTTP Write to a Spatiotemporal Data Store ActiveMQ EsriGallery Cursor-on-Target Flume Hadoop (HDFS) Kafka MongoDB * MQTT RabbitMQ Twitter * *
- 51. Two patterns Getting Real-Time Data into Web Applications • Feature layers pull from feature services - Web apps poll to get periodic updates - Must be backed by an enterprise geodatabase (EGDB) • Stream layers subscribe to stream services - Web apps subscribe to immediately receive data - Low latency and high throughput GeoEvent Extension ArcGIS Server Your Applications Stream Layer Map Services Feature Services Feature Layer feature layers Update a Feature Add a Feature EGDB Polling (Pull) Stream Services Send Features to a Stream Service
- 52. The Fallacy of Time “Dissemination active” scientists have higher publication values (p<0.3) “Dissemination activities compel scientists to open up their horizons to discuss with people having other points of view... which could improve their academic research.” Jensen et al. (2008). Scientists who engage with society perform better academically, Science & Public Policy, 7(35): 527-541. Hellmann and Williams, AAAS 2013
- 53. “We don’t want geospatial data to be an afterthought. If you’re not engaged in policy discussions, we’re missing the boat. In trying to solve policy problems, geography can be used as an actual policy driver.” Mike Byrne, GIO of the Federal Communications Commission FedGeo Day 2013, Washington, D.C. as reported by FCW.com Another Quote
Notas del editor
- .
- The standard view of GIS. But in the talk I hope to convey that “this is not just about your eyeballs on a map, it’s looking at the invisible rubber bands of mathematical manipulation of these different layers.” It’s about the coupling of the appropriate data, analysis and manipulation, and compelling design to effectively communicate the results, and when appropriate, the possible models and future scenarios.
- Thanks to Adam Mollenkopf, Esri Real-Time GIS Capability Team Lead and Ricardo Trujillo, GeoEvent Developer, amollenkopf@esri.com, rtrujillo@esri.com links.esri.com/geoevent-wiki We aim to register large data stores / data sets with ArcGIS Server, then distribute analysis across a cluster of machines for parallel processing Performance example: buffer 8.2 million points or thousands of polygons in a little over a minute, Coming: ~250,000 writes to disk per second across 5 nodes Many frameworks/technologies exist for distributing computation E.g., Hadoop, MapReduce, Spark Spark: processes distributed data in memory; Supports MapReduce programming model Includes additional framework level distributed algorithms ArcGIS Server integrates these technologies on a cluster to solve analytic problems
- Parallelized batch analytics on tabular, vector, raster, and imagery datasets (big and standard data) Performance example: buffer 8.2 million points or thousands of polygons in a little over a minute, NetCDF output is supported on … Aggregate Points – Point in polygon aggregation (spatial join) Aggregate by Cell – simple aggregation Summarize Nearby – spatial join where left dataset and a distance are used to inflate the bounding box. A distance calculation is then employed (no drivetime/distance). Summarize Within – a spatial join that is a generalization of Aggregate Points Find Existing Locations – an attribute query followed by/with a spatial query (?); the attribute portion is SparkSQL, the spatial relationship is: intersections, within distance, contains, and within. Find Similar Locations – non-spatial similarity search (SparkSQL). Calculate Density – cell-based spatial aggregation by attribute with a weighted neighborhood/distance-based summarization. Find Hot Spots – very similar to Calculate Density but with the Getis-Ord Gi* statistic. This can be cell-based (point observations) or polygon-based (polygon source data). Create Buffers – simple spatial buffer generation across the dataset (the Java geometry library supports Euclidean and Geodetic buffer generation). This is done. Extract Data – a simple region query with a specified output format. Field (RASTER) Calculator – apply a Scala or SQL expression to each feature, one expression per field.
- To show that we’re practicing what we preach, this just released this weekend.
- Along these lines we certainly want to engender interoperability and crosswalking among approaches, such as the examples here with the Python Scientific Computing Environment, or simple integration with a host of scientific tools and libraries.
- Along these lines we certainly want to engender interoperability and crosswalking among approaches, such as the examples here with the Python Scientific Computing Environment, or simple integration with a host of scientific tools and libraries.
- Along these lines we certainly want to engender interoperability and crosswalking among approaches, such as the examples here with the Python Scientific Computing Environment, or simple integration with a host of scientific tools and libraries.
- Thanks to Adam Mollenkopf, Esri Real-Time GIS Capability Team Lead and Ricardo Trujillo, GeoEvent Developer, amollenkopf@esri.com, rtrujillo@esri.com links.esri.com/geoevent-wiki We aim to register large data stores / data sets with ArcGIS Server, then distribute analysis across a cluster of machines for parallel processing Performance example: buffer 8.2 million points or thousands of polygons in a little over a minute, Many frameworks/technologies exist for distributing computation E.g., Hadoop, MapReduce, Spark Spark: processes distributed data in memory Supports MapReduce programming model Includes additional framework level distributed algorithms ArcGIS Server integrates these technologies on a cluster to solve analytic problems
- SITUATIONAL AWARENESS!!!
- GIS “dashboard” used by Los Angeles Bureau of Sanitation. SITUATIONAL AWARENESS!!! To build a more efficient maintenance tracking and routing mechanism for its sanitation force, the Los Angeles Solid Resources Collection Division (SRCD) thoroughly integrated Esri cloud and mobile technology into its fleet management workflow, increasing routing accuracy, saving time, and conserving fuel. Pickups include trash but also yard trimmings, recyclables, and animal carcasses — as well as derelict large appliances. Esri complements Zonar fleet data (vehicle parameters, such as GPS location, speed, odometer, and truck fault codes) by displaying fleet location and other data specific to operations in maps fed with Esri GeoEvent-processed data. The integration of inspection data into the bureau’s GIS allows them to automate curb-side route generation and provide real-time ETA for service calls.
- Demonstration of use of Esri Geoevent Processor to track Liquid Robotics wave gliders in the Gulf of Mexico, with the Operations Dashboard app displaying the parameters measured by the wave glider in near real time. Courtesy of Shin Kobara of Texas A&M working in concert with the U. of Southern Mississippi and for the Gulf Coast Ocean Observing System. Luca Centurioni’s global drifter lab at Scripps has a modified Liquid Robotics Wave Glider.
- active vessels dashboard, takes in live feeds of exactEarth AIS data, then calculates and creates a "hot spot" map of vessel activity. In future: gain more detailed examples of patterns exhibited by the different types of fishing (trawling, long line, etc.) so that our analysis engine would know better what to look for. We'd also want to code in abilities to: detect, associate and analyze behavior of groups of vessels over time, so as to use these existing patterns to find similar patterns in new data being added to the system. - use predicted patterns of behavior to predict fishing areas and periods so as to more efficiently determine where and how to spend spatial analysis time
- “Hexagons are good for visualization because they nest together perfectly and look good [when zoomed in].” Easy now with computer cartography “Hexagons and other regularly shaped features allow you to normalize geography for thematic mapping rather than be constrained to using irregular shaped polygons created from a political process (for example, county boundaries, census tracts, zip codes, etc.). – Damian Spangrud- See more at: http://blogs.esri.com/esri/esri-insider/2015/04/08/thematic-mapping-with-hexagons/#sthash.u6hs0cyc.dpuf From Mansour Raad and the Esri Big Data Team: http://coolmaps.esri.com/BigData/ShippingTracks/
- From Mansour Raad and the Esri Big Data Team: coolmaps.esri.com/BigData/ShippingGlobe
- very cool, new 3D Dashboard, built w/Javascript 4.1 (browser must be WebGL-enabled) http://arcg.is/1Pg7Jlg #GIS
- We may get maps, we very often don't get graphs, but we are absolutely hardwired to understand stories. As such, scientists MUST tell their STORY and th the importance of story every single scientific success is perfect fodder for a narrative structure “People are moved by emotion. The best way to emotionally connect other people to our agenda begins with “Once upon a time…” Science backs up the long-held belief that story is the most powerful means of communicating a message. Over the last several decades psychology has begun a serious study of how story affects the human mind. Results repeatedly show that our attitudes, fears, hopes, and values are strongly influenced by story. In fact, fiction seems to be more effective at changing beliefs than writing that is specifically designed to persuade through argument and evidence.” http://www.fastcocreate.com/1680581/why-storytelling-is-the-ultimate-weapon Scientists are often encouraged not to publish their work until it constitutes a complete story. Why not combine BOTH, especially to take advantage of the power of maps and geography to educate, inform, and inspire people to action as well? The story map is about using maps in new and innovative ways to get people excited and involved in the world. Thanks to continuing changes in the Internet, cloud computing, mobile and tablet platforms, and to constant improvements in the software itself, we can now put the power of GIS into the hands of managers, CEOs, reporters, school kids—even policy makers.
- “STORIES ARE STICKY” “People are moved by emotion. The best way to emotionally connect other people to our agenda begins with “Once upon a time…” Science backs up the long-held belief that story is the most powerful means of communicating a message. Over the last several decades psychology has begun a serious study of how story affects the human mind. Results repeatedly show that our attitudes, fears, hopes, and values are strongly influenced by story. In fact, fiction seems to be more effective at changing beliefs than writing that is specifically designed to persuade through argument and evidence.” http://www.fastcocreate.com/1680581/why-storytelling-is-the-ultimate-weapon Scientists are often encouraged not to publish their work until it constitutes a complete story. Why not combine BOTH, especially to take advantage of the power of maps and geography to educate, inform, and inspire people to action as well? The story map is about using maps in new and innovative ways to get people excited and involved in the world. Thanks to continuing changes in the Internet, cloud computing, mobile and tablet platforms, and to constant improvements in the software itself, we can now put the power of GIS into the hands of managers, CEOs, reporters, school kids—even policy makers.
- Good storytelling to avoid situations like this! Cartoon licensed personally to Dawn Wright by The New Yorker Cartoon Bank, TCB-86966, Invoice Number: L12480
- Danish Sargasso Sea Story Map Technical University of Denmark’s (DTU) research vessel Dana was on an expedition in the Sargasso Sea in March and April 2014 to examine the role of climate-induced changes in spawning zones in the sole violent decline in Europe.
- Given the challenges that our planet faces, I hope the oceanographic and geospatial communities will ponder and discuss if science communication should be made a formal part of higher ed curricula and professional GIS certification, and further, whether communicating with policy makers should now be considered an ethical issue. Many of us are moving beyond the ivory tower and have students who seek to do the same, or at least not wanting to be clones of their advisers in academic roles. In a world where success is still measured by publications and grants, there are institutional and cultural barriers to overcome.
- Scientists (and some resource managers) need to invert their mode and progression of communication (left triangle shows what we would communicate in a scientific paper, which is not what a policy maker (or journalist for that matter) will receive well or understand. Scientists want to explain how the world works but policy-makers needs us to inform their decision, and we can inform their decision by telling them a good story. Journalists want us to tell them a good story too.
- COMPASS is a bridge organization founded in 1999 by former NOAA Administrator Jane Lubchenco et al. and dedicated to helping scientists connect themselves and their science to the wider world. By giving scientists the communication tools they need, and by bridging the worlds of science, journalism and policy, COMPASS works to ensure that science is better understood and used by society. For the last decade, COMPASS has focused on ocean science and scientists (and the acronym originally stood for Communication Partnership for Science and the Sea). Recognizing the connection between oceans, land, air, and water-- and in response to requests from scientists outside the marine world-- COMPASS is beginning to expand its scope (and the name is no longer an acronym).
- AM
- AM
- AM
- AM
- From Hellman, J.J. and Williams, J.W., 2013. Strategies for engaging outside the Ivory Tower and how to find the time to do it. Proceedings of the AAAS Annual Meeting, Boston, MA, http://aaas.confex.com/aaas/2013/webprogram/Paper9629.html