SlideShare una empresa de Scribd logo
1 de 16
Descargar para leer sin conexión
3-GIS Confidential and proprietary.
Benchmarking tree approaches on street data
Fabion Kauker - fkauker@3-gis.com
EURO30 Dublin, Ireland 2019
Problem definition & Questions
• We want to find topologies on data that relates to possible routes for
the creation of infrastructure.
• Many methods exist, but which are most advantageous and for what
applications?
• Can we use street data as a starting point?
• What would the software look like and how could it be used?
Data and representations
● Many formats
○ SHP, TAB, csv, geoJSON …
● Many tools
○ ESRI, QGIS, MapInfo …
● Many sources
○ OSM, open address, municipal, commercial
Key Geometry
Point → (lat, lon)
LineString → [(lat_1, lon_1),..., (lat_n,lon_n)]
Polygon → [(lat_1, lon_1),..., (lat_1,lon_1)]
Geometry to Graph
Karduni, A., Kermanshah, A., & Derrible, S. (2016). A protocol to convert spatial polyline data to network
formats and applications to world urban road networks
1. https://github.com/fhk/test_data
2. https://observablehq.com/@d3/force-directed-graph
(1) (2)
Baking a graph
Given that we have some geometry we
want to derive the graph structure.
Where:
vertex/node == Point or LineString
endpoint
and
edge/arc == LineString endpoint to
LineString endpoint
Directional vs. Undirected
degree 2 nodes = degree 1 nodes
Why Homebaked v. Open Source?
Python
networkx
graph-tool
Baked in algos
Edge and node access
Connected components
Used for path computation
Representations:
adjacency list or matrix
Compute origin destination
matrix/lookup
Simple assembly
Let’s just round to a level of accuracy
Currently using 6 decimal places on
lat lon coordinates
Stringify the coordinates
Assign unique ids
Should probably convert to
euclidean, or use a projection ...
Implications of rounding...
https://en.wikipedia.org/wiki/Decimal_degrees
Given a graph we want to utilize modelling
approaches...
Pre-compute intermediate inputs
Create formulation or data input
Run model
Parse solution
1) http://people.csail.mit.edu/ludwigs/papers/icml15_graphsparsity.pdf
2) http://people.csail.mit.edu/ludwigs/papers/dimacs14_fastpcst.pdf
3) https://github.com/fraenkel-lab/pcst_fast
4) https://cran.r-project.org/web/packages/tbart/index.html
5) https://pubsonline.informs.org/doi/abs/10.1287/opre.16.5.955
6) Goldman AJ (1971) Optimal center location in simple networks. Transp Sci 5:212–221
7) https://pdfs.semanticscholar.org/2094/882d425fe9b3f668eaafbcf8ac0bba478b5f.pdf
8) Ljubić et al. (2005). Solving the Prize-Collecting {Steiner} Tree Problem to Optimality
Network flow MIP
(adapted from Ljubić et al)
Assignment MIP
Tietz-Bart p-median
Hegde et al. Prize Collecting
Steiner Tree (PCST)
Graph to MIP
Flow
source
sinkFlow conservation
constraints
Arc and node
based variables
Assignment
Path and
candidate/demand
variables
candidate demand
Note: be sure to try out fstrings in python 3.6+
Why compare apples and oranges?
Create shared and accessible
benchmarks
Create an extensible framework for
development
Create a web deployable library
Explore combinations and search
techniques
Document caveats
Create extensibility
Explore User Experience (UX)
Develop understanding in industry
How was benchmarking done?
https://github.com/fhk/test_data
1. Source data
2. Process data
3. Wrap “link_src” lib
4. Solve and time
5. Process time
6. Process results
7. Create visualization
Solver: CPLEX
Time limit 1800 seconds
Benchmarks
Benchmarks
PCST fast on Denmark
Demo
How?
GeoJSON
Web Server
Python
flask
networkx
graph-tool
R t-bart
pcst_fast
docplex
fiona
{url}/v1/{method}
methods:
pcst
pmed
spamp
nfmp
Transform GeoJSON to
graph
Create model input
data
Construct
formulation/algorithm
Run algorithm/solver
Extract/match solution
Output GeoJSON
Browser
js
Mapbox-gl
Mapbox-gl-draw
Ajax
turf
Questions?
Github - https://github.com/fhk/link_src & https://github.com/fhk/test_data
Contribute models
Further learning
Solver tuning
Huertic implementation
Tiers
RL approaches
Publication to PhD
Come solve industry problems - roles at 3-GIS
Contact:
fkauker@3-gis.com

Más contenido relacionado

La actualidad más candente

Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...Mumbai B.Sc.IT Study
 
Trb 2017 annual_conference_visualization_lightning_talk_rst
Trb 2017 annual_conference_visualization_lightning_talk_rstTrb 2017 annual_conference_visualization_lightning_talk_rst
Trb 2017 annual_conference_visualization_lightning_talk_rstRobert Tung
 
Data visualization using R
Data visualization using RData visualization using R
Data visualization using RUmmiya Mohammedi
 
Hexagonify the World: The Theory and Applications of Uber H3
Hexagonify the World: The Theory and Applications of Uber H3Hexagonify the World: The Theory and Applications of Uber H3
Hexagonify the World: The Theory and Applications of Uber H3Safe Software
 
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.Anita Graser
 
20131216 Stat Journal
20131216 Stat Journal20131216 Stat Journal
20131216 Stat JournalMed_KU
 
Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Communicating meaning and purpose of spatio-temporal data analysis (master's ...Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Communicating meaning and purpose of spatio-temporal data analysis (master's ...Matthias Hinz
 
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHubEuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHubMartin Christen
 
Postal Address Clean-Up - Two Unusual FME Workbench Applications
Postal Address Clean-Up - Two Unusual FME Workbench ApplicationsPostal Address Clean-Up - Two Unusual FME Workbench Applications
Postal Address Clean-Up - Two Unusual FME Workbench ApplicationsSafe Software
 
GIS and Map Tiles
GIS and Map TilesGIS and Map Tiles
GIS and Map TilesPetr Pridal
 
Graph of UK train stations
Graph of UK train stationsGraph of UK train stations
Graph of UK train stationsDaniyar Mukhanov
 
Exploring Abandoned GIS Research to Augment Applied Geography Education
Exploring Abandoned GIS Research to Augment Applied Geography EducationExploring Abandoned GIS Research to Augment Applied Geography Education
Exploring Abandoned GIS Research to Augment Applied Geography EducationMichael DeMers
 

La actualidad más candente (20)

Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
Geographic Information Systems (April – 2015) [Question Paper | IDOL: Revised...
 
Trb 2017 annual_conference_visualization_lightning_talk_rst
Trb 2017 annual_conference_visualization_lightning_talk_rstTrb 2017 annual_conference_visualization_lightning_talk_rst
Trb 2017 annual_conference_visualization_lightning_talk_rst
 
Data visualization using R
Data visualization using RData visualization using R
Data visualization using R
 
Data visualization with R
Data visualization with RData visualization with R
Data visualization with R
 
Vishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random TreesVishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random Trees
 
Spatial is Not Special ?
Spatial is Not Special ?Spatial is Not Special ?
Spatial is Not Special ?
 
Hexagonify the World: The Theory and Applications of Uber H3
Hexagonify the World: The Theory and Applications of Uber H3Hexagonify the World: The Theory and Applications of Uber H3
Hexagonify the World: The Theory and Applications of Uber H3
 
Big data in GIS Environment
Big data in GIS Environment Big data in GIS Environment
Big data in GIS Environment
 
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
Big Spatial(!) Data Processing mit GeoMesa. AGIT 2019, Salzburg, Austria.
 
Arrow and Visual Model
Arrow and Visual ModelArrow and Visual Model
Arrow and Visual Model
 
A Real Life Research Tool in Second Life: PrimPlotter
A Real Life Research Tool in Second Life: PrimPlotterA Real Life Research Tool in Second Life: PrimPlotter
A Real Life Research Tool in Second Life: PrimPlotter
 
20131216 Stat Journal
20131216 Stat Journal20131216 Stat Journal
20131216 Stat Journal
 
Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Communicating meaning and purpose of spatio-temporal data analysis (master's ...Communicating meaning and purpose of spatio-temporal data analysis (master's ...
Communicating meaning and purpose of spatio-temporal data analysis (master's ...
 
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHubEuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
EuroPython 2019: GeoSpatial Analysis using Python and JupyterHub
 
3D printing of digital elevation models
3D printing of digital elevation models3D printing of digital elevation models
3D printing of digital elevation models
 
Aag 2017
Aag 2017Aag 2017
Aag 2017
 
Postal Address Clean-Up - Two Unusual FME Workbench Applications
Postal Address Clean-Up - Two Unusual FME Workbench ApplicationsPostal Address Clean-Up - Two Unusual FME Workbench Applications
Postal Address Clean-Up - Two Unusual FME Workbench Applications
 
GIS and Map Tiles
GIS and Map TilesGIS and Map Tiles
GIS and Map Tiles
 
Graph of UK train stations
Graph of UK train stationsGraph of UK train stations
Graph of UK train stations
 
Exploring Abandoned GIS Research to Augment Applied Geography Education
Exploring Abandoned GIS Research to Augment Applied Geography EducationExploring Abandoned GIS Research to Augment Applied Geography Education
Exploring Abandoned GIS Research to Augment Applied Geography Education
 

Similar a Euro30 2019 - Benchmarking tree approaches on street data

The Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing SystemsThe Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing SystemsNeo4j
 
Informs 2019 - Flexible Network Design Utilizing Non Strict Modeling Approaches
Informs 2019  - Flexible Network Design Utilizing Non Strict Modeling ApproachesInforms 2019  - Flexible Network Design Utilizing Non Strict Modeling Approaches
Informs 2019 - Flexible Network Design Utilizing Non Strict Modeling ApproachesFabion Kauker
 
How to empower community by using GIS lecture 1
How to empower community by using GIS lecture 1How to empower community by using GIS lecture 1
How to empower community by using GIS lecture 1wang yaohui
 
Spark summit europe 2015 magellan
Spark summit europe 2015 magellanSpark summit europe 2015 magellan
Spark summit europe 2015 magellanRam Sriharsha
 
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONSBIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONScscpconf
 
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions csandit
 
Magellen: Geospatial Analytics on Spark by Ram Sriharsha
Magellen: Geospatial Analytics on Spark by Ram SriharshaMagellen: Geospatial Analytics on Spark by Ram Sriharsha
Magellen: Geospatial Analytics on Spark by Ram SriharshaSpark Summit
 
On the-design-of-geographic-information-system-procedures
On the-design-of-geographic-information-system-proceduresOn the-design-of-geographic-information-system-procedures
On the-design-of-geographic-information-system-proceduresArmando Guevara
 
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and ProcessingA Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and ProcessingPayamBarnaghi
 
EDBT 2015: Summer School Overview
EDBT 2015: Summer School OverviewEDBT 2015: Summer School Overview
EDBT 2015: Summer School Overviewdgarijo
 
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...Punit Sharnagat
 
mini project_shortest path visualizer.pptx
mini project_shortest path visualizer.pptxmini project_shortest path visualizer.pptx
mini project_shortest path visualizer.pptxtusharpawar803067
 
Representation Learning on Complex Graphs
Representation Learning on Complex GraphsRepresentation Learning on Complex Graphs
Representation Learning on Complex GraphseXascale Infolab
 
Spatial Data processing with Hadoop
Spatial Data processing with HadoopSpatial Data processing with Hadoop
Spatial Data processing with HadoopVisionGEOMATIQUE2014
 
Visualising large spatial databases and Building bespoke geodemographics
Visualising large spatial databases and Building bespoke geodemographicsVisualising large spatial databases and Building bespoke geodemographics
Visualising large spatial databases and Building bespoke geodemographicsDr Muhammad Adnan
 
Shortest path estimation for graph
Shortest path estimation for graphShortest path estimation for graph
Shortest path estimation for graphijdms
 
Streaming HYpothesis REasoning
Streaming HYpothesis REasoningStreaming HYpothesis REasoning
Streaming HYpothesis REasoningWilliam Smith
 

Similar a Euro30 2019 - Benchmarking tree approaches on street data (20)

The Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing SystemsThe Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing Systems
 
Informs 2019 - Flexible Network Design Utilizing Non Strict Modeling Approaches
Informs 2019  - Flexible Network Design Utilizing Non Strict Modeling ApproachesInforms 2019  - Flexible Network Design Utilizing Non Strict Modeling Approaches
Informs 2019 - Flexible Network Design Utilizing Non Strict Modeling Approaches
 
How to empower community by using GIS lecture 1
How to empower community by using GIS lecture 1How to empower community by using GIS lecture 1
How to empower community by using GIS lecture 1
 
Spark summit europe 2015 magellan
Spark summit europe 2015 magellanSpark summit europe 2015 magellan
Spark summit europe 2015 magellan
 
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONSBIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
BIG GRAPH: TOOLS, TECHNIQUES, ISSUES, CHALLENGES AND FUTURE DIRECTIONS
 
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
Big Graph : Tools, Techniques, Issues, Challenges and Future Directions
 
PointNet
PointNetPointNet
PointNet
 
Magellen: Geospatial Analytics on Spark by Ram Sriharsha
Magellen: Geospatial Analytics on Spark by Ram SriharshaMagellen: Geospatial Analytics on Spark by Ram Sriharsha
Magellen: Geospatial Analytics on Spark by Ram Sriharsha
 
Portfolio
PortfolioPortfolio
Portfolio
 
On the-design-of-geographic-information-system-procedures
On the-design-of-geographic-information-system-proceduresOn the-design-of-geographic-information-system-procedures
On the-design-of-geographic-information-system-procedures
 
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and ProcessingA Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
A Knowledge-based Approach for Real-Time IoT Stream Annotation and Processing
 
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdfMODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
MODEL_FOR_SEMANTICALLY_RICH_POINT_CLOUD.pdf
 
EDBT 2015: Summer School Overview
EDBT 2015: Summer School OverviewEDBT 2015: Summer School Overview
EDBT 2015: Summer School Overview
 
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
Graph Centric Analysis of Road Network Patterns for CBD’s of Metropolitan Cit...
 
mini project_shortest path visualizer.pptx
mini project_shortest path visualizer.pptxmini project_shortest path visualizer.pptx
mini project_shortest path visualizer.pptx
 
Representation Learning on Complex Graphs
Representation Learning on Complex GraphsRepresentation Learning on Complex Graphs
Representation Learning on Complex Graphs
 
Spatial Data processing with Hadoop
Spatial Data processing with HadoopSpatial Data processing with Hadoop
Spatial Data processing with Hadoop
 
Visualising large spatial databases and Building bespoke geodemographics
Visualising large spatial databases and Building bespoke geodemographicsVisualising large spatial databases and Building bespoke geodemographics
Visualising large spatial databases and Building bespoke geodemographics
 
Shortest path estimation for graph
Shortest path estimation for graphShortest path estimation for graph
Shortest path estimation for graph
 
Streaming HYpothesis REasoning
Streaming HYpothesis REasoningStreaming HYpothesis REasoning
Streaming HYpothesis REasoning
 

Último

Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 

Último (20)

Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 

Euro30 2019 - Benchmarking tree approaches on street data

  • 1. 3-GIS Confidential and proprietary. Benchmarking tree approaches on street data Fabion Kauker - fkauker@3-gis.com EURO30 Dublin, Ireland 2019
  • 2. Problem definition & Questions • We want to find topologies on data that relates to possible routes for the creation of infrastructure. • Many methods exist, but which are most advantageous and for what applications? • Can we use street data as a starting point? • What would the software look like and how could it be used?
  • 3. Data and representations ● Many formats ○ SHP, TAB, csv, geoJSON … ● Many tools ○ ESRI, QGIS, MapInfo … ● Many sources ○ OSM, open address, municipal, commercial Key Geometry Point → (lat, lon) LineString → [(lat_1, lon_1),..., (lat_n,lon_n)] Polygon → [(lat_1, lon_1),..., (lat_1,lon_1)]
  • 4. Geometry to Graph Karduni, A., Kermanshah, A., & Derrible, S. (2016). A protocol to convert spatial polyline data to network formats and applications to world urban road networks 1. https://github.com/fhk/test_data 2. https://observablehq.com/@d3/force-directed-graph (1) (2)
  • 5. Baking a graph Given that we have some geometry we want to derive the graph structure. Where: vertex/node == Point or LineString endpoint and edge/arc == LineString endpoint to LineString endpoint Directional vs. Undirected degree 2 nodes = degree 1 nodes Why Homebaked v. Open Source? Python networkx graph-tool Baked in algos Edge and node access Connected components Used for path computation Representations: adjacency list or matrix Compute origin destination matrix/lookup Simple assembly Let’s just round to a level of accuracy Currently using 6 decimal places on lat lon coordinates Stringify the coordinates Assign unique ids Should probably convert to euclidean, or use a projection ...
  • 7. Given a graph we want to utilize modelling approaches... Pre-compute intermediate inputs Create formulation or data input Run model Parse solution 1) http://people.csail.mit.edu/ludwigs/papers/icml15_graphsparsity.pdf 2) http://people.csail.mit.edu/ludwigs/papers/dimacs14_fastpcst.pdf 3) https://github.com/fraenkel-lab/pcst_fast 4) https://cran.r-project.org/web/packages/tbart/index.html 5) https://pubsonline.informs.org/doi/abs/10.1287/opre.16.5.955 6) Goldman AJ (1971) Optimal center location in simple networks. Transp Sci 5:212–221 7) https://pdfs.semanticscholar.org/2094/882d425fe9b3f668eaafbcf8ac0bba478b5f.pdf 8) Ljubić et al. (2005). Solving the Prize-Collecting {Steiner} Tree Problem to Optimality Network flow MIP (adapted from Ljubić et al) Assignment MIP Tietz-Bart p-median Hegde et al. Prize Collecting Steiner Tree (PCST)
  • 8. Graph to MIP Flow source sinkFlow conservation constraints Arc and node based variables Assignment Path and candidate/demand variables candidate demand Note: be sure to try out fstrings in python 3.6+
  • 9. Why compare apples and oranges? Create shared and accessible benchmarks Create an extensible framework for development Create a web deployable library Explore combinations and search techniques Document caveats Create extensibility Explore User Experience (UX) Develop understanding in industry
  • 10. How was benchmarking done? https://github.com/fhk/test_data 1. Source data 2. Process data 3. Wrap “link_src” lib 4. Solve and time 5. Process time 6. Process results 7. Create visualization Solver: CPLEX Time limit 1800 seconds
  • 13. PCST fast on Denmark
  • 14. Demo
  • 15. How? GeoJSON Web Server Python flask networkx graph-tool R t-bart pcst_fast docplex fiona {url}/v1/{method} methods: pcst pmed spamp nfmp Transform GeoJSON to graph Create model input data Construct formulation/algorithm Run algorithm/solver Extract/match solution Output GeoJSON Browser js Mapbox-gl Mapbox-gl-draw Ajax turf
  • 16. Questions? Github - https://github.com/fhk/link_src & https://github.com/fhk/test_data Contribute models Further learning Solver tuning Huertic implementation Tiers RL approaches Publication to PhD Come solve industry problems - roles at 3-GIS Contact: fkauker@3-gis.com