SlideShare una empresa de Scribd logo
1 de 20
Use of FME Workbench in Edmonton’s
Open Data Catalogue

Bohdan Hrynyshyn
City of Edmonton
IT Business Analyst, Open Data Team

                                      Edmonton, Alberta - April 12, 2013
What is Open Data?
 Certain data to be freely available for everyone to use and
 republish as they wish, without restrictions or control

Rationale
 Data generated or collected by public organizations belong to
  taxpayers, and where releasing it will not violate any laws or
  rights to privacy

 Component of Open Government
    Building and maintaining relationships between
     government and citizens by sharing ideas and information
Why Open Data?


Make Local Government More ….
    Open
    Accountable
    Accessible
Open Government …..

 Encourage a Constant Exchange of Ideas




 Want Government to make better decisions for all of us
Openness ……..

 Laws and Decisions Open for Discussion
 Collaboration in policy-making, policy
  implementation, and policy enforcement
Accessibility ……..
 Budgets may be reviewed by anyone
 Government does not have all the answers – participation
  through various communication tools
 Public mayhave necessary knowledge and experience to
  deal with issues
 Economic opportunities by turning data into apps, web-sites
  or other useful products
Accountability ……
 Public Officials are Accountable
 Government meetings are open to everyone
 Civic engagement, stakeholder groups collaboration,
  collaborative public management, and dispute resolution
  with citizens and stakeholders have answerability
Why Open Data Edmonton?
    make accessible, data about Edmonton’s municipal services to Edmonton's
     citizens, media, and public


    Why Are We Doing This?
    City committed to better manage business information
    Provide easy access to public Data Assets
    Improve accessibility, transparency and accountability for City Of Edmonton data
    Increase engagement of citizens, community organizations and private businesses
     in creative community problem solving and development of innovative services,
     applications and solutions
    Promote ‘One City’ concept - one location for all city data
    Integrate data from various discrete data-sets to provide more value and
     intelligence
About Edmonton’s Open Data
 The City of Edmonton - dedicated to using technology to make municipal information
 more open, transparent and accessible.


History
Open Data Principles ……

 1. Complete
     Data not subject to privacy, legislative, security or privilege limitations

 2. Primary
     Data collected at source
     Granularity at lowest level possible
     not in aggregate or modified form

 3. Timely
     Data is current and relevant

 4. Accessible
     to wide range of users
     for many different purposes
Open Data Principles ……

  5. Machine processable
      Data structured for automated processing

  6. Non-discriminatory Access
      Data available to anyone, with no requirements

  7. Non-Proprietary Format
      Data available in format no entity has exclusive control

  8. Data license-free
      Data not subject to any copyright, patent, trademark or
       regulations
Open Data Infrastructure
Why Use FME?

 Transform (restructure, reformat, and integrate)
  spatial and non-spatial data into proper format
  and structure for loading into Socrata’s Open
  Data Catalogue

 Add spatial components to non-spatial data so it
  can be readily visualized on a map in Socrata’s
  Open Data Catalogue
How to publish Open Data Cycle

 Choose Data for Release
 Prepare data extract in Open Format (csv, xls,
  shp)
 Create Open Data page on Catalogue
 Create Meta Data for dataset
 Make Dataset public
FME Transformers

   AttributeKeeper
   AttributeRenamer
   CoordinateExtractor
   NullAttributeReplacer
   Reprojector
   Sorter
   StringConcatenator
   StringSearcher
   Tester
Trees
List of all trees owned and maintained by the City of Edmonton

https://data.edmonton.ca/Environmental-Services/Trees-Species-Map-View-/cggb-hzzm



                                                                                    •extract data from SLIM (Oracle)
                                                                                    • format and filter in FME
                                                                                    • output as csv file
City Properties for Sale
List of all City-owned properties for sale
https://data.edmonton.ca/City-Administration/City-of-Edmonton-s-Properties-for-Sale/yutc-c5ju




                                                                                 • extract view data from SLIM (Oracle) and POSSE
                                                                                 • format and filter in FME
                                                                                 • output as csv file
City of Edmonton/NAIT Solar Panel Reference System -
Daily Power Production
Daily production of electrical power from solar panels located at NAIT

https://data.edmonton.ca/Environmental-Services/City-of-Edmonton-NAIT-Solar-Panel-Reference-System/ysgw-us2d




                                                                         •assemble “scraped” data for each panel
                                                                         from vendor using FME
                                                                         • format and consolidate each panel
                                                                         • output as csv file
Portable Signs
List of all licensed portable signs in the City

https://data.edmonton.ca/Sustainable-Development/Temporary-Signs-Map/xt3a-rjpj



                                                                         •extract data from POSSE Data Warehouse
                                                                         • format and filter in FME
                                                                         • output as csv file
Thank You!

 Questions?

 For more information:
   Bohdan Hrynyshyn – City of Edmonton, IT Branch

   bohdan.hrynyshyn@edmonton.ca

   opendata@edmonton.ca

Más contenido relacionado

Más de Safe Software

Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
Safe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
Safe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Safe Software
 

Más de Safe Software (20)

The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FME
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework
 
Bringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleBringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) People
 
Democratizing Transformer Creation in FME
Democratizing Transformer Creation in FMEDemocratizing Transformer Creation in FME
Democratizing Transformer Creation in FME
 
Working Forward: From Data to Location Intelligence for Renewables Siting and...
Working Forward: From Data to Location Intelligence for Renewables Siting and...Working Forward: From Data to Location Intelligence for Renewables Siting and...
Working Forward: From Data to Location Intelligence for Renewables Siting and...
 
Datendrehscheibe im eGovernment
Datendrehscheibe im eGovernmentDatendrehscheibe im eGovernment
Datendrehscheibe im eGovernment
 
Zugriff auf alle raumbezogenen Daten - direkt in Ihrem WebGIS durch FME
Zugriff auf alle raumbezogenen Daten - direkt in Ihrem WebGIS durch FMEZugriff auf alle raumbezogenen Daten - direkt in Ihrem WebGIS durch FME
Zugriff auf alle raumbezogenen Daten - direkt in Ihrem WebGIS durch FME
 

Último

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Último (20)

08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 

Using FME to Create Open Data Datasets

  • 1. Use of FME Workbench in Edmonton’s Open Data Catalogue Bohdan Hrynyshyn City of Edmonton IT Business Analyst, Open Data Team Edmonton, Alberta - April 12, 2013
  • 2. What is Open Data? Certain data to be freely available for everyone to use and republish as they wish, without restrictions or control Rationale  Data generated or collected by public organizations belong to taxpayers, and where releasing it will not violate any laws or rights to privacy  Component of Open Government  Building and maintaining relationships between government and citizens by sharing ideas and information
  • 3. Why Open Data? Make Local Government More ….  Open  Accountable  Accessible
  • 4. Open Government …..  Encourage a Constant Exchange of Ideas Want Government to make better decisions for all of us
  • 5. Openness ……..  Laws and Decisions Open for Discussion  Collaboration in policy-making, policy implementation, and policy enforcement
  • 6. Accessibility ……..  Budgets may be reviewed by anyone  Government does not have all the answers – participation through various communication tools  Public mayhave necessary knowledge and experience to deal with issues  Economic opportunities by turning data into apps, web-sites or other useful products
  • 7. Accountability ……  Public Officials are Accountable  Government meetings are open to everyone  Civic engagement, stakeholder groups collaboration, collaborative public management, and dispute resolution with citizens and stakeholders have answerability
  • 8. Why Open Data Edmonton?  make accessible, data about Edmonton’s municipal services to Edmonton's citizens, media, and public Why Are We Doing This?  City committed to better manage business information  Provide easy access to public Data Assets  Improve accessibility, transparency and accountability for City Of Edmonton data  Increase engagement of citizens, community organizations and private businesses in creative community problem solving and development of innovative services, applications and solutions  Promote ‘One City’ concept - one location for all city data  Integrate data from various discrete data-sets to provide more value and intelligence
  • 9. About Edmonton’s Open Data The City of Edmonton - dedicated to using technology to make municipal information more open, transparent and accessible. History
  • 10. Open Data Principles ……  1. Complete  Data not subject to privacy, legislative, security or privilege limitations  2. Primary  Data collected at source  Granularity at lowest level possible  not in aggregate or modified form  3. Timely  Data is current and relevant  4. Accessible  to wide range of users  for many different purposes
  • 11. Open Data Principles ……  5. Machine processable  Data structured for automated processing  6. Non-discriminatory Access  Data available to anyone, with no requirements  7. Non-Proprietary Format  Data available in format no entity has exclusive control  8. Data license-free  Data not subject to any copyright, patent, trademark or regulations
  • 13. Why Use FME?  Transform (restructure, reformat, and integrate) spatial and non-spatial data into proper format and structure for loading into Socrata’s Open Data Catalogue  Add spatial components to non-spatial data so it can be readily visualized on a map in Socrata’s Open Data Catalogue
  • 14. How to publish Open Data Cycle  Choose Data for Release  Prepare data extract in Open Format (csv, xls, shp)  Create Open Data page on Catalogue  Create Meta Data for dataset  Make Dataset public
  • 15. FME Transformers  AttributeKeeper  AttributeRenamer  CoordinateExtractor  NullAttributeReplacer  Reprojector  Sorter  StringConcatenator  StringSearcher  Tester
  • 16. Trees List of all trees owned and maintained by the City of Edmonton https://data.edmonton.ca/Environmental-Services/Trees-Species-Map-View-/cggb-hzzm •extract data from SLIM (Oracle) • format and filter in FME • output as csv file
  • 17. City Properties for Sale List of all City-owned properties for sale https://data.edmonton.ca/City-Administration/City-of-Edmonton-s-Properties-for-Sale/yutc-c5ju • extract view data from SLIM (Oracle) and POSSE • format and filter in FME • output as csv file
  • 18. City of Edmonton/NAIT Solar Panel Reference System - Daily Power Production Daily production of electrical power from solar panels located at NAIT https://data.edmonton.ca/Environmental-Services/City-of-Edmonton-NAIT-Solar-Panel-Reference-System/ysgw-us2d •assemble “scraped” data for each panel from vendor using FME • format and consolidate each panel • output as csv file
  • 19. Portable Signs List of all licensed portable signs in the City https://data.edmonton.ca/Sustainable-Development/Temporary-Signs-Map/xt3a-rjpj •extract data from POSSE Data Warehouse • format and filter in FME • output as csv file
  • 20. Thank You!  Questions?  For more information:  Bohdan Hrynyshyn – City of Edmonton, IT Branch  bohdan.hrynyshyn@edmonton.ca  opendata@edmonton.ca