SlideShare una empresa de Scribd logo
1 de 21
FME Applications in
New York City GIS
Chris Rado, GIS Manager (CSCL)
NYC Dept. of Information Technology
and Telecommunications
DoITT GIS Team
Obligatory IT Diagram
My IT diagram
Developed after 9/11 to serve as an authoritative source of addresses and location info
- Consolidated data: streets, addresses, common places, etc.
- 5-day update cycle (Mayor’s Executive Order #39)
- Data distribution system
- CSCL is Hosted by DoITT
- Maintained jointly by DoITT and Dept. of City Planning (DCP) since 2009
- Governance by 7 City Agencies (DoITT, DCP, NYPD, FDNY, NYC EM, DOT, and DEP)
Citywide Street
Centerline Geodatabase
(CSCL)
CSCL is really, really, really designed
7 City Agencies + 2 Contractors + ESRI Advisors =
68 feature classes
40 tables
47 Relationship Classes
2 Feature Datasets
8 Topology rules
93 Domains
2 Subtypes….. plus Custom ArcMap Editing tools!
Wait, don’t go! It’s only our Data Model
CSCL Data Distribution System
CSCL Database
ESRI GDB Replication
This is the FME part…
NYC EM
DOT
9-1-1 Call-taking
NYPD Dispatch
Transportation
planning and analysis
Fire/EMS Dispatch
NYPD
FDNY
Disaster planning,
response, and recovery
“Published” CSCL data for City Agencies and NYC
OpenData
CSCL was designed for maintenance, so...
NYPD
FDNY
CSCL Replicas Custom coded ETLs
ArcObjects (Pokemons)
NYPD
FDNY
Export GDBs E911 and Dispatch
CAD Systems
CSCL Published
CSCL
This part
broke.
A Stab from the Past!
FME is in the
ESRI Data Interop
Extension…
Spatial ETL Tool Version
“Direct Copy” Data
“Named Intersection” Data
Writes simultaneously to FGDB and SDE. Nice!
Centerline export tool snapshot
Slimming effects of ETL process
Before After
Automation Issues #1
ArcPy integration of Spatial ETL tools
Batch file calls Python script which activates Spatial ETL tools
Automation Issues #2
ESRI Workflow Manager bug NIM090873
Standalone FME
I got my agency to buy something!
1 floating license and one FME upgrade from ESRI Data Interop vs
$50,000 (or worse) for software consulting services
Provisioned VM exclusively to run FME processes
Easier to run FMWs as scheduled tasks
Can open FMW files created by others
Updated software (v2016 vs v2013) e.g. Socrata Writer
FME v2016 is 64bit vs 32bit version in Data Interop
Best of all- We have full control of our ETL
Converting Spatial ETL tool to FMW
a) Saving the ESRI-created FMW files to new *.FMW
names
b) Copy/pasting the Readers, Writers, Transformers
from Spatial ETL tools to FME 2016 Workbench
c) Recreating the old tools in FME 2016 Workbench-
this worked the best.
Loose ends…
How does FME use the machine resources?
Local run = 2 hours (Xeon 3.2GHz/8GB/Win 7 64)
Server run = 4 hours (Quad 2.6GHz /8GB/ WinServer R2 64)
“Memory allocation” freezing for converted tools
Recreated tools in FME 2016 had same problem
Safe Software Support case C111319
Moved to 64 bit FME
Changed out some Feature Holders for Cloners
Other FME uses
Direct updates to SDE from anything: xlsx, WFS, Access….
QC Tools for CSCL data maintenance
Previously Model Builder, Python (ArcPy), Python Toolbox
Metadata handling (once we figure it out)
FME Documentation for the XML stuff is not awesome
Linear Referencing applications, a hard sell…
Replacement of other ETL custom software
Once they taste our cooking….
Batman!
Batcomputer!
Thanks!
Chris Rado, GIS Manager (CSCL)
NYC DoITT
chrado@doitt.nyc.gov

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Bridging the Gap Between Unequal Partners
Bridging the Gap Between Unequal PartnersBridging the Gap Between Unequal Partners
Bridging the Gap Between Unequal Partners
 
Processing Rasters from Satellites, Drones, & More
Processing Rasters from Satellites, Drones, & MoreProcessing Rasters from Satellites, Drones, & More
Processing Rasters from Satellites, Drones, & More
 
From Outdoor to Indoor: 3D and Venue Mapping – FME Summer Camp
From Outdoor to Indoor: 3D and Venue Mapping – FME Summer CampFrom Outdoor to Indoor: 3D and Venue Mapping – FME Summer Camp
From Outdoor to Indoor: 3D and Venue Mapping – FME Summer Camp
 
Automating Engineering with FME
Automating Engineering with FMEAutomating Engineering with FME
Automating Engineering with FME
 
Coordinate Systems in FME 101
Coordinate Systems in FME 101 Coordinate Systems in FME 101
Coordinate Systems in FME 101
 
Blending Enterprise Data with FME Server
Blending Enterprise Data with FME ServerBlending Enterprise Data with FME Server
Blending Enterprise Data with FME Server
 
FME in Support of DOT Data Culture
FME in Support of DOT Data CultureFME in Support of DOT Data Culture
FME in Support of DOT Data Culture
 
Aggregation and standardization of financial transactions from multiple marke...
Aggregation and standardization of financial transactions from multiple marke...Aggregation and standardization of financial transactions from multiple marke...
Aggregation and standardization of financial transactions from multiple marke...
 
Brewing the Ultimate Data Fusion
Brewing the Ultimate Data FusionBrewing the Ultimate Data Fusion
Brewing the Ultimate Data Fusion
 
Exploring KML Transformers
Exploring KML TransformersExploring KML Transformers
Exploring KML Transformers
 
5 Ways to Improve Your LiDAR Workflows
5 Ways to Improve Your LiDAR Workflows5 Ways to Improve Your LiDAR Workflows
5 Ways to Improve Your LiDAR Workflows
 
Preparing LiDAR for Use in ArcGIS 10.1 with the Data Interoperability Extension
Preparing LiDAR for Use in ArcGIS 10.1 with the Data Interoperability ExtensionPreparing LiDAR for Use in ArcGIS 10.1 with the Data Interoperability Extension
Preparing LiDAR for Use in ArcGIS 10.1 with the Data Interoperability Extension
 
Utilities Industry Success Stories with FME
Utilities Industry Success Stories with FME Utilities Industry Success Stories with FME
Utilities Industry Success Stories with FME
 
FME World Tour 2015 Belfast - Introduction to FME - Ciaran Kirk
FME World Tour 2015 Belfast - Introduction to FME - Ciaran KirkFME World Tour 2015 Belfast - Introduction to FME - Ciaran Kirk
FME World Tour 2015 Belfast - Introduction to FME - Ciaran Kirk
 
Mapwise in the Field with GPS
Mapwise in the Field with GPSMapwise in the Field with GPS
Mapwise in the Field with GPS
 
How to Supercharge your Location Data and Reporting & Analysis
How to Supercharge your Location Data and Reporting & AnalysisHow to Supercharge your Location Data and Reporting & Analysis
How to Supercharge your Location Data and Reporting & Analysis
 
Leveraging Autodesk Products with FME: AutoCAD to GIS is Only the Beginning
Leveraging Autodesk Products with FME: AutoCAD to GIS is Only the BeginningLeveraging Autodesk Products with FME: AutoCAD to GIS is Only the Beginning
Leveraging Autodesk Products with FME: AutoCAD to GIS is Only the Beginning
 
Prepare LiDAR Data To Meet Your Requirements
Prepare LiDAR Data To Meet Your RequirementsPrepare LiDAR Data To Meet Your Requirements
Prepare LiDAR Data To Meet Your Requirements
 
Gain Total Control of Your LiDAR and Point Cloud Data
Gain Total Control of Your LiDAR and Point Cloud DataGain Total Control of Your LiDAR and Point Cloud Data
Gain Total Control of Your LiDAR and Point Cloud Data
 
Bridging Between CAD & GIS: 8 Ways to Automate Data Integration
Bridging Between CAD & GIS: 8 Ways to Automate Data IntegrationBridging Between CAD & GIS: 8 Ways to Automate Data Integration
Bridging Between CAD & GIS: 8 Ways to Automate Data Integration
 

Destacado

Real Estate Decision Support System based on GIS
Real Estate Decision  Support System  based on GIS Real Estate Decision  Support System  based on GIS
Real Estate Decision Support System based on GIS
Srabani Das
 
2 (14092012) dasar-dasar perencanaan jalan raya
2  (14092012) dasar-dasar perencanaan jalan raya2  (14092012) dasar-dasar perencanaan jalan raya
2 (14092012) dasar-dasar perencanaan jalan raya
mrtunsyiah
 
Pile foundation design
Pile foundation designPile foundation design
Pile foundation design
UTHM
 

Destacado (20)

FME to the Rescue
FME to the RescueFME to the Rescue
FME to the Rescue
 
11 rigid-pavement
11 rigid-pavement11 rigid-pavement
11 rigid-pavement
 
Applications of Maps & GIS for Real Estate
Applications of Maps & GIS for Real EstateApplications of Maps & GIS for Real Estate
Applications of Maps & GIS for Real Estate
 
GIS Project Profile EGIS Solutions Ltd
GIS Project Profile EGIS Solutions LtdGIS Project Profile EGIS Solutions Ltd
GIS Project Profile EGIS Solutions Ltd
 
Using GIS for better e-services - Smart Cities
Using GIS for better e-services - Smart CitiesUsing GIS for better e-services - Smart Cities
Using GIS for better e-services - Smart Cities
 
Smart City with GIS
Smart City with GISSmart City with GIS
Smart City with GIS
 
Improve your Real Estate Business with Mapping Analytics
Improve your Real Estate Business with Mapping AnalyticsImprove your Real Estate Business with Mapping Analytics
Improve your Real Estate Business with Mapping Analytics
 
Real Estate Decision Support System based on GIS
Real Estate Decision  Support System  based on GIS Real Estate Decision  Support System  based on GIS
Real Estate Decision Support System based on GIS
 
Implementing ArcGIS for Water Utilities
Implementing ArcGIS for Water UtilitiesImplementing ArcGIS for Water Utilities
Implementing ArcGIS for Water Utilities
 
United Utilities and GIS
United Utilities and GISUnited Utilities and GIS
United Utilities and GIS
 
GIS in Water Utility Management.
GIS in Water Utility Management.GIS in Water Utility Management.
GIS in Water Utility Management.
 
Uses of GIS Technology in Real Estate
Uses of GIS Technology in Real EstateUses of GIS Technology in Real Estate
Uses of GIS Technology in Real Estate
 
Introduction to GIS and its Applications
Introduction to GIS and its ApplicationsIntroduction to GIS and its Applications
Introduction to GIS and its Applications
 
GIS for Revenue Collection and Management
GIS for Revenue Collection and ManagementGIS for Revenue Collection and Management
GIS for Revenue Collection and Management
 
2 (14092012) dasar-dasar perencanaan jalan raya
2  (14092012) dasar-dasar perencanaan jalan raya2  (14092012) dasar-dasar perencanaan jalan raya
2 (14092012) dasar-dasar perencanaan jalan raya
 
Perencanaan perkerasan jalan raya
Perencanaan perkerasan jalan rayaPerencanaan perkerasan jalan raya
Perencanaan perkerasan jalan raya
 
Smart Applications for Smart City
Smart Applications for Smart CitySmart Applications for Smart City
Smart Applications for Smart City
 
Kuliah minggu ke 9 struktur jembatan,06 nopb2012
Kuliah minggu ke 9 struktur jembatan,06 nopb2012Kuliah minggu ke 9 struktur jembatan,06 nopb2012
Kuliah minggu ke 9 struktur jembatan,06 nopb2012
 
Contoh Desain Perkerasan Jalan
Contoh Desain Perkerasan JalanContoh Desain Perkerasan Jalan
Contoh Desain Perkerasan Jalan
 
Pile foundation design
Pile foundation designPile foundation design
Pile foundation design
 

Similar a FME Applications in New York City GIS

Similar a FME Applications in New York City GIS (20)

FME World Tour 2015 - Curing Migration Flu or: How I Learned to Stop Worrying...
FME World Tour 2015 - Curing Migration Flu or: How I Learned to Stop Worrying...FME World Tour 2015 - Curing Migration Flu or: How I Learned to Stop Worrying...
FME World Tour 2015 - Curing Migration Flu or: How I Learned to Stop Worrying...
 
Curing Migration Flu or: How I Learned to Stop Worrying and Love the LGIM
Curing Migration Flu or: How I Learned to Stop Worrying and Love the LGIMCuring Migration Flu or: How I Learned to Stop Worrying and Love the LGIM
Curing Migration Flu or: How I Learned to Stop Worrying and Love the LGIM
 
FME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken BraggFME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken Bragg
 
Finns Using FME Like Crazy
Finns Using FME Like CrazyFinns Using FME Like Crazy
Finns Using FME Like Crazy
 
Vancouver Uses FME to Open Data to the World
Vancouver Uses FME to Open Data to the WorldVancouver Uses FME to Open Data to the World
Vancouver Uses FME to Open Data to the World
 
Hdf eos status-workshp_xi_nov_2007
Hdf eos status-workshp_xi_nov_2007Hdf eos status-workshp_xi_nov_2007
Hdf eos status-workshp_xi_nov_2007
 
Reporting Summary Information of Spatial Datasets and Non-Compliance Issues U...
Reporting Summary Information of Spatial Datasets and Non-Compliance Issues U...Reporting Summary Information of Spatial Datasets and Non-Compliance Issues U...
Reporting Summary Information of Spatial Datasets and Non-Compliance Issues U...
 
FME = Features Made Easy
FME = Features Made EasyFME = Features Made Easy
FME = Features Made Easy
 
FME User Stories from Around the World
FME User Stories from Around the WorldFME User Stories from Around the World
FME User Stories from Around the World
 
HDF-EOS Maintenance, Current Development and Tools
HDF-EOS Maintenance, Current Development and ToolsHDF-EOS Maintenance, Current Development and Tools
HDF-EOS Maintenance, Current Development and Tools
 
FME Around the World (FME Trek Part 1): Ken Bragg - Safe Software FME World T...
FME Around the World (FME Trek Part 1): Ken Bragg - Safe Software FME World T...FME Around the World (FME Trek Part 1): Ken Bragg - Safe Software FME World T...
FME Around the World (FME Trek Part 1): Ken Bragg - Safe Software FME World T...
 
DhevendranResume
DhevendranResumeDhevendranResume
DhevendranResume
 
Infrastructure student
Infrastructure studentInfrastructure student
Infrastructure student
 
Extracting Data from GE Smallworld into Common Information Model (CIM XML)
Extracting Data from GE Smallworld into Common Information Model (CIM XML)Extracting Data from GE Smallworld into Common Information Model (CIM XML)
Extracting Data from GE Smallworld into Common Information Model (CIM XML)
 
Extend the Value of Your BIM Data with FME: Part 1
Extend the Value of Your BIM Data with FME: Part 1Extend the Value of Your BIM Data with FME: Part 1
Extend the Value of Your BIM Data with FME: Part 1
 
IoT and connected devices
IoT and connected devicesIoT and connected devices
IoT and connected devices
 
What's New in ArcGIS 10.1 Data Interoperability Extension
What's New in ArcGIS 10.1 Data Interoperability ExtensionWhat's New in ArcGIS 10.1 Data Interoperability Extension
What's New in ArcGIS 10.1 Data Interoperability Extension
 
Biztalk
BiztalkBiztalk
Biztalk
 
Introduction to map reduce
Introduction to map reduceIntroduction to map reduce
Introduction to map reduce
 
SOCET GXP and FME, Creating an Integrated System for Geospatial Analysis and ...
SOCET GXP and FME, Creating an Integrated System for Geospatial Analysis and ...SOCET GXP and FME, Creating an Integrated System for Geospatial Analysis and ...
SOCET GXP and FME, Creating an Integrated System for Geospatial Analysis and ...
 

Más de Safe Software

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
Safe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
Safe Software
 

Más de Safe Software (20)

The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 

Último

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Último (20)

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 

FME Applications in New York City GIS

  • 1. FME Applications in New York City GIS Chris Rado, GIS Manager (CSCL) NYC Dept. of Information Technology and Telecommunications
  • 4. My IT diagram Developed after 9/11 to serve as an authoritative source of addresses and location info - Consolidated data: streets, addresses, common places, etc. - 5-day update cycle (Mayor’s Executive Order #39) - Data distribution system - CSCL is Hosted by DoITT - Maintained jointly by DoITT and Dept. of City Planning (DCP) since 2009 - Governance by 7 City Agencies (DoITT, DCP, NYPD, FDNY, NYC EM, DOT, and DEP) Citywide Street Centerline Geodatabase (CSCL)
  • 5. CSCL is really, really, really designed 7 City Agencies + 2 Contractors + ESRI Advisors = 68 feature classes 40 tables 47 Relationship Classes 2 Feature Datasets 8 Topology rules 93 Domains 2 Subtypes….. plus Custom ArcMap Editing tools!
  • 6. Wait, don’t go! It’s only our Data Model
  • 7. CSCL Data Distribution System CSCL Database ESRI GDB Replication This is the FME part… NYC EM DOT 9-1-1 Call-taking NYPD Dispatch Transportation planning and analysis Fire/EMS Dispatch NYPD FDNY Disaster planning, response, and recovery “Published” CSCL data for City Agencies and NYC OpenData
  • 8. CSCL was designed for maintenance, so... NYPD FDNY CSCL Replicas Custom coded ETLs ArcObjects (Pokemons) NYPD FDNY Export GDBs E911 and Dispatch CAD Systems CSCL Published CSCL This part broke.
  • 9. A Stab from the Past! FME is in the ESRI Data Interop Extension…
  • 10. Spatial ETL Tool Version “Direct Copy” Data “Named Intersection” Data Writes simultaneously to FGDB and SDE. Nice!
  • 12. Slimming effects of ETL process Before After
  • 13. Automation Issues #1 ArcPy integration of Spatial ETL tools Batch file calls Python script which activates Spatial ETL tools
  • 14. Automation Issues #2 ESRI Workflow Manager bug NIM090873
  • 15. Standalone FME I got my agency to buy something! 1 floating license and one FME upgrade from ESRI Data Interop vs $50,000 (or worse) for software consulting services Provisioned VM exclusively to run FME processes Easier to run FMWs as scheduled tasks Can open FMW files created by others Updated software (v2016 vs v2013) e.g. Socrata Writer FME v2016 is 64bit vs 32bit version in Data Interop Best of all- We have full control of our ETL
  • 16. Converting Spatial ETL tool to FMW a) Saving the ESRI-created FMW files to new *.FMW names b) Copy/pasting the Readers, Writers, Transformers from Spatial ETL tools to FME 2016 Workbench c) Recreating the old tools in FME 2016 Workbench- this worked the best.
  • 17. Loose ends… How does FME use the machine resources? Local run = 2 hours (Xeon 3.2GHz/8GB/Win 7 64) Server run = 4 hours (Quad 2.6GHz /8GB/ WinServer R2 64) “Memory allocation” freezing for converted tools Recreated tools in FME 2016 had same problem Safe Software Support case C111319 Moved to 64 bit FME Changed out some Feature Holders for Cloners
  • 18. Other FME uses Direct updates to SDE from anything: xlsx, WFS, Access…. QC Tools for CSCL data maintenance Previously Model Builder, Python (ArcPy), Python Toolbox Metadata handling (once we figure it out) FME Documentation for the XML stuff is not awesome Linear Referencing applications, a hard sell… Replacement of other ETL custom software Once they taste our cooking….
  • 21. Thanks! Chris Rado, GIS Manager (CSCL) NYC DoITT chrado@doitt.nyc.gov