SlideShare una empresa de Scribd logo
1 de 9
Descargar para leer sin conexión
ArcticWeb

        Erin Lynch
         KADME
Knowledge and Data Management Expertise
ArcticWeb: Geoportal to
   public information
• ArcticWeb aims to simplify access to
public data by making terms searchable
from multiple sources at once.


• Multi-field data exchange: Integrate
multiple public data sources published
without standards, in multiple languages,
on a map and in a table.
     Our Whereoil technology extracts and makes sense of information published by energy websites, in shared
                             repositories, internal file systems and project databases.
PSI in Norway

• Resources are not exposed

• Data found in various formats,
  inconsistently, among various data
  owners

• Access to all levels of public data is
  political, not technical.
Approach
• Crawlers (scrapers) continuously harvest
  predefined information

• Data scraped from Excel, CSV, HTML,
  RSS, PDF and other web services

• Stored data in metastore and geostore
                   ArcticWeb Search
                         Engine




             Geodata
ArcticWeb Search Engine
 RSS Feeds
                       Web Services



 PDF
                        Databases



                         Web
Non-Standard
  Protocols           HTML Pages
Interoperability

• Data aggregation: There is no
  interoperability across the key data
  owners.

• Interoperability created by caching data
  in a common framework
Public Data via Search or by
                    Geographical Location




Data is correlated and overlapping. Selected areas highlighted on left,
viewable on map.
  This is an example of a search-based integration of a wide-range of data sources in different standards, correlated via search terms and
geographical locations. We used Whereoil to remove the need for data providers to accept standard data formats and publish standard web
                                   services. This system is applicable to other industries and datasets.
Findings


• Populate the metadata!
• Standards
• Give Data Owners clear mandate to make
 data more easily available
Thanks!




    www.kadme.com
  Contact: erin@kadme.com
@KadmeAS @ArcticWebdotcom

Más contenido relacionado

Más de ePSI Platform

E psi open data - rejseplanen
E psi   open data - rejseplanenE psi   open data - rejseplanen
E psi open data - rejseplanenePSI Platform
 
Ds.e psi conference.21 22.02.2013
Ds.e psi conference.21 22.02.2013Ds.e psi conference.21 22.02.2013
Ds.e psi conference.21 22.02.2013ePSI Platform
 
Christian Laux on Liability
Christian Laux on LiabilityChristian Laux on Liability
Christian Laux on LiabilityePSI Platform
 
Liability for open data
Liability for open dataLiability for open data
Liability for open dataePSI Platform
 
Big Data Session Presentations
Big Data Session PresentationsBig Data Session Presentations
Big Data Session PresentationsePSI Platform
 
Otwarte zabytki epsi
Otwarte zabytki epsiOtwarte zabytki epsi
Otwarte zabytki epsiePSI Platform
 
E psi tomek-zielinski-transportoid-conference-slides
E psi tomek-zielinski-transportoid-conference-slidesE psi tomek-zielinski-transportoid-conference-slides
E psi tomek-zielinski-transportoid-conference-slidesePSI Platform
 
PSI Re-use in Bulgaria
PSI Re-use in BulgariaPSI Re-use in Bulgaria
PSI Re-use in BulgariaePSI Platform
 
Hamburg Transparency Law
Hamburg Transparency LawHamburg Transparency Law
Hamburg Transparency LawePSI Platform
 
Open Data: the state of the European Union
Open Data: the state of the European UnionOpen Data: the state of the European Union
Open Data: the state of the European UnionePSI Platform
 
Psi group scoreboard
Psi group scoreboardPsi group scoreboard
Psi group scoreboardePSI Platform
 
Community Building as Scaffolding for a Working Public Sector
Community Building as Scaffolding for a Working Public SectorCommunity Building as Scaffolding for a Working Public Sector
Community Building as Scaffolding for a Working Public SectorePSI Platform
 
Making Open Data Work for the Public Sector
Making Open Data Work for the Public SectorMaking Open Data Work for the Public Sector
Making Open Data Work for the Public SectorePSI Platform
 
Cleaning up the relationship with our government
Cleaning up the relationship with our governmentCleaning up the relationship with our government
Cleaning up the relationship with our governmentePSI Platform
 
Open Data Opportunities
Open Data OpportunitiesOpen Data Opportunities
Open Data OpportunitiesePSI Platform
 
Creating Impact with Open Data
Creating Impact with Open DataCreating Impact with Open Data
Creating Impact with Open DataePSI Platform
 
Transport Data Is Like .....
Transport Data Is Like .....Transport Data Is Like .....
Transport Data Is Like .....ePSI Platform
 
EU Open Data Strategy
EU Open Data StrategyEU Open Data Strategy
EU Open Data StrategyePSI Platform
 

Más de ePSI Platform (20)

E psi open data - rejseplanen
E psi   open data - rejseplanenE psi   open data - rejseplanen
E psi open data - rejseplanen
 
Ds.e psi conference.21 22.02.2013
Ds.e psi conference.21 22.02.2013Ds.e psi conference.21 22.02.2013
Ds.e psi conference.21 22.02.2013
 
Christian Laux on Liability
Christian Laux on LiabilityChristian Laux on Liability
Christian Laux on Liability
 
Liability for open data
Liability for open dataLiability for open data
Liability for open data
 
Big Data Session Presentations
Big Data Session PresentationsBig Data Session Presentations
Big Data Session Presentations
 
Sl lgo
Sl lgoSl lgo
Sl lgo
 
Otwarte zabytki epsi
Otwarte zabytki epsiOtwarte zabytki epsi
Otwarte zabytki epsi
 
E psi tomek-zielinski-transportoid-conference-slides
E psi tomek-zielinski-transportoid-conference-slidesE psi tomek-zielinski-transportoid-conference-slides
E psi tomek-zielinski-transportoid-conference-slides
 
Moja polis basic
Moja polis basicMoja polis basic
Moja polis basic
 
PSI Re-use in Bulgaria
PSI Re-use in BulgariaPSI Re-use in Bulgaria
PSI Re-use in Bulgaria
 
Hamburg Transparency Law
Hamburg Transparency LawHamburg Transparency Law
Hamburg Transparency Law
 
Open Data: the state of the European Union
Open Data: the state of the European UnionOpen Data: the state of the European Union
Open Data: the state of the European Union
 
Psi group scoreboard
Psi group scoreboardPsi group scoreboard
Psi group scoreboard
 
Community Building as Scaffolding for a Working Public Sector
Community Building as Scaffolding for a Working Public SectorCommunity Building as Scaffolding for a Working Public Sector
Community Building as Scaffolding for a Working Public Sector
 
Making Open Data Work for the Public Sector
Making Open Data Work for the Public SectorMaking Open Data Work for the Public Sector
Making Open Data Work for the Public Sector
 
Cleaning up the relationship with our government
Cleaning up the relationship with our governmentCleaning up the relationship with our government
Cleaning up the relationship with our government
 
Open Data Opportunities
Open Data OpportunitiesOpen Data Opportunities
Open Data Opportunities
 
Creating Impact with Open Data
Creating Impact with Open DataCreating Impact with Open Data
Creating Impact with Open Data
 
Transport Data Is Like .....
Transport Data Is Like .....Transport Data Is Like .....
Transport Data Is Like .....
 
EU Open Data Strategy
EU Open Data StrategyEU Open Data Strategy
EU Open Data Strategy
 

Último

TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 

Último (20)

TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 

Kadme

  • 1. ArcticWeb Erin Lynch KADME Knowledge and Data Management Expertise
  • 2. ArcticWeb: Geoportal to public information • ArcticWeb aims to simplify access to public data by making terms searchable from multiple sources at once. • Multi-field data exchange: Integrate multiple public data sources published without standards, in multiple languages, on a map and in a table. Our Whereoil technology extracts and makes sense of information published by energy websites, in shared repositories, internal file systems and project databases.
  • 3. PSI in Norway • Resources are not exposed • Data found in various formats, inconsistently, among various data owners • Access to all levels of public data is political, not technical.
  • 4. Approach • Crawlers (scrapers) continuously harvest predefined information • Data scraped from Excel, CSV, HTML, RSS, PDF and other web services • Stored data in metastore and geostore ArcticWeb Search Engine Geodata
  • 5. ArcticWeb Search Engine RSS Feeds Web Services PDF Databases Web Non-Standard Protocols HTML Pages
  • 6. Interoperability • Data aggregation: There is no interoperability across the key data owners. • Interoperability created by caching data in a common framework
  • 7. Public Data via Search or by Geographical Location Data is correlated and overlapping. Selected areas highlighted on left, viewable on map. This is an example of a search-based integration of a wide-range of data sources in different standards, correlated via search terms and geographical locations. We used Whereoil to remove the need for data providers to accept standard data formats and publish standard web services. This system is applicable to other industries and datasets.
  • 8. Findings • Populate the metadata! • Standards • Give Data Owners clear mandate to make data more easily available
  • 9. Thanks! www.kadme.com Contact: erin@kadme.com @KadmeAS @ArcticWebdotcom