SlideShare una empresa de Scribd logo
1 de 22
Descargar para leer sin conexión
CONNECT. TRANSFORM. AUTOMATE.
ETL GISSUB
Alessandro da Silva
Civil Engineer and GIS Analyst
Summary
1.  ABOUT PETROBRAS
2.  WHAT DOES GEODESY DEPARTMENT DO?
3.  SGO
4.  ETL
5.  GISSUB
6.  IN PROGRESS
7.  QUESTIONS
CONNECT. TRANSFORM. AUTOMATE.
PETROBRAS
PETROBRAS
EXPLORATION AND
PRODUCTION
E&P SERVICES
SUBSEA SERVICES
UNIT
GEODESY DIVISION
!  PETROBRAS in numbers:
•  5th biggest energy company in the world;
•  Daily Production: 2.021.000 barrels/day +/- 2%;
•  Frota de navios : 242 (56 da Petrobras);
•  Dutos: 30.067km (rígidos e flexíveis);
•  15 Refineries and 27 plants;
•  We are at 28 countries;
•  90% of production is from subsea wells.
•  12 Vessels installing pipelines 24/7.
GEODESY DEPARTMENT
Positioning
Mapping
SGO
!  SGO is a system developed to process, store and
share data related to subsea pipelines,
equipments and platforms installed by Petrobras.
!  Used for planing and safe execution of all offshore
operations, avoiding accidents in facilities and
reflexes for people and enviroment.
!  Is CAD based – Started in 1995 (MicroStation).
!  18.500 access in May 2014.
!  Users in more than 300 vessels.
670m
ETL
!  Why ETL?
•  Create GIS tools in CAD (Queries, Searchs,
Attributes, Topology...) is an arduous task;
•  Keep a CAD based structure updated every day (44
dgn files in Campos Basin – 8 professionals);
•  Backup in DVDs;
•  More than one UTM zone;
•  Build a structure to GIS systems;
•  Data Validation (Geometry, Topology, attributes);
•  Interoperability;
•  Good data to build good solutions;
•  Have more than visualization.
ETL
!  What does the ETL do?
•  Extracts data from CAD;
•  Transform them, doing all validations and creating
geometries according to each element behavior;
•  Loads them into a customized APDM (ArcGIS
Pipeline Data Model – World Standar) Oracle
Spatial Database.
ETL
ETL
!  Requirements
•  Treat each element (46) separately according to
the engineering and connectivity rules (Anchors,
Anchor Lines, Pipelines, Platforms, WCTs,
Manifolds, Connectors...);
•  Treat Cell elements;
•  Improve security;
•  Remove Microlines;
•  Update the Database every day;
•  Leave nothing behind;
•  Keep removed features (history);
•  Report the errors.
ETL
!  Around 130 rules;
!  Some Rules:
•  A regular Anchor connects to an Anchor Line;
•  A regular connector is suppose to have at least two
pieces of pipelines;
•  A WCT has always to be in a well head;
•  A PLET always connects a steel pipeline to a flexible
one;
•  There are no lines with less than 1 meter of length;
•  Cathodic Protection, in SGO, just in steel pipelines.
ETL
DGN TO FFS - Workbench
Takes 90 minutes to run
ETL
DGN TO FFS
Workbench
ETL
Anchor - Workbench
Takes 10 minutes to run
ETL
Pipeline - Workbench
Takes 49 minutes to run
GISSUB
IN PROGRESS
!  Geometric Network
IN PROGRESS
!  Connection among elements – Geometric
Network
IN PROGRESS
!  Connecting other databases
IN PROGRESS
!  FME SERVER
Thank You!
!  Questions?
!  For more information:
!  Alessandro da Silva
ale.silva.fototerra@petrobras.com.br
!  Fototerra/Petrobras
CONNECT. TRANSFORM. AUTOMATE.

Más contenido relacionado

Similar a ETL GISSUB: Connecting, Transforming and Automating Subsea Infrastructure Data

CIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
CIGREAUB5SEAPAC2015PPT68_AU_Haines-revisedCIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
CIGREAUB5SEAPAC2015PPT68_AU_Haines-revisedBen Haines
 
Interchangeable skids provide plug and-play capabilities, improve uptime
Interchangeable skids provide plug and-play capabilities, improve uptimeInterchangeable skids provide plug and-play capabilities, improve uptime
Interchangeable skids provide plug and-play capabilities, improve uptimeIntelligentManufacturingInstitute
 
POLYTEDA PowerDRC/LVS overview
POLYTEDA PowerDRC/LVS overviewPOLYTEDA PowerDRC/LVS overview
POLYTEDA PowerDRC/LVS overviewAlexander Grudanov
 
Remote Handling Activities and Overview
Remote Handling Activities and OverviewRemote Handling Activities and Overview
Remote Handling Activities and OverviewElena V. Rosa Adame
 
Scada For G Mgt
Scada For G MgtScada For G Mgt
Scada For G MgtAnil Patil
 
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...SSBT's C.O.E.T., Bambhori, Jalgaon
 
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel QueriesChristo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel QueriesChristo Kutrovsky
 
Rapid Control Prototyping Solutions
Rapid Control Prototyping SolutionsRapid Control Prototyping Solutions
Rapid Control Prototyping SolutionsOPAL-RT TECHNOLOGIES
 
Nick Vasiliu Resume Electrical Design Engineer 2017
Nick Vasiliu Resume Electrical Design Engineer 2017Nick Vasiliu Resume Electrical Design Engineer 2017
Nick Vasiliu Resume Electrical Design Engineer 2017Nicolae Vasiliu
 
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介ShinsukeAiki1
 
Saurabh Singh - CV.DOC
Saurabh Singh - CV.DOCSaurabh Singh - CV.DOC
Saurabh Singh - CV.DOCsaurabh singh
 
RLE Technologies | How Leak Detection Can Minimize Catastrophes
RLE Technologies | How Leak Detection Can Minimize CatastrophesRLE Technologies | How Leak Detection Can Minimize Catastrophes
RLE Technologies | How Leak Detection Can Minimize CatastrophesCochrane_Supply
 
Short.course.introduction.to.vhdl for beginners
Short.course.introduction.to.vhdl for beginners Short.course.introduction.to.vhdl for beginners
Short.course.introduction.to.vhdl for beginners Ravi Sony
 
AgileSwitch SiC Product Overview
AgileSwitch SiC Product OverviewAgileSwitch SiC Product Overview
AgileSwitch SiC Product OverviewJames Charlton
 
The Data Center and Hadoop
The Data Center and HadoopThe Data Center and Hadoop
The Data Center and HadoopDataWorks Summit
 
Aerospace maintenance facility increases utilization by 50%, saves money
Aerospace maintenance facility increases utilization by 50%, saves moneyAerospace maintenance facility increases utilization by 50%, saves money
Aerospace maintenance facility increases utilization by 50%, saves moneyIntelligentManufacturingInstitute
 

Similar a ETL GISSUB: Connecting, Transforming and Automating Subsea Infrastructure Data (20)

CIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
CIGREAUB5SEAPAC2015PPT68_AU_Haines-revisedCIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
CIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
 
Interchangeable skids provide plug and-play capabilities, improve uptime
Interchangeable skids provide plug and-play capabilities, improve uptimeInterchangeable skids provide plug and-play capabilities, improve uptime
Interchangeable skids provide plug and-play capabilities, improve uptime
 
6600ingles
6600ingles6600ingles
6600ingles
 
Bathymetry ME Thesis
Bathymetry ME ThesisBathymetry ME Thesis
Bathymetry ME Thesis
 
POLYTEDA PowerDRC/LVS overview
POLYTEDA PowerDRC/LVS overviewPOLYTEDA PowerDRC/LVS overview
POLYTEDA PowerDRC/LVS overview
 
Remote Handling Activities and Overview
Remote Handling Activities and OverviewRemote Handling Activities and Overview
Remote Handling Activities and Overview
 
Scada For G Mgt
Scada For G MgtScada For G Mgt
Scada For G Mgt
 
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
 
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel QueriesChristo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
 
Rapid Control Prototyping Solutions
Rapid Control Prototyping SolutionsRapid Control Prototyping Solutions
Rapid Control Prototyping Solutions
 
Nick Vasiliu Resume Electrical Design Engineer 2017
Nick Vasiliu Resume Electrical Design Engineer 2017Nick Vasiliu Resume Electrical Design Engineer 2017
Nick Vasiliu Resume Electrical Design Engineer 2017
 
Corralling Big Data at TACC
Corralling Big Data at TACCCorralling Big Data at TACC
Corralling Big Data at TACC
 
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
 
Saurabh Singh - CV.DOC
Saurabh Singh - CV.DOCSaurabh Singh - CV.DOC
Saurabh Singh - CV.DOC
 
RLE Technologies | How Leak Detection Can Minimize Catastrophes
RLE Technologies | How Leak Detection Can Minimize CatastrophesRLE Technologies | How Leak Detection Can Minimize Catastrophes
RLE Technologies | How Leak Detection Can Minimize Catastrophes
 
Short.course.introduction.to.vhdl for beginners
Short.course.introduction.to.vhdl for beginners Short.course.introduction.to.vhdl for beginners
Short.course.introduction.to.vhdl for beginners
 
sairam_CV
sairam_CVsairam_CV
sairam_CV
 
AgileSwitch SiC Product Overview
AgileSwitch SiC Product OverviewAgileSwitch SiC Product Overview
AgileSwitch SiC Product Overview
 
The Data Center and Hadoop
The Data Center and HadoopThe Data Center and Hadoop
The Data Center and Hadoop
 
Aerospace maintenance facility increases utilization by 50%, saves money
Aerospace maintenance facility increases utilization by 50%, saves moneyAerospace maintenance facility increases utilization by 50%, saves money
Aerospace maintenance facility increases utilization by 50%, saves money
 

Más de Safe Software

Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsSafe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemSafe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISSafe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriSafe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfSafe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologySafe Software
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersSafe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsSafe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategySafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Safe Software
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMESafe Software
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Safe Software
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Safe Software
 

Más de Safe Software (20)

Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FME
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework
 

Último

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 

Último (20)

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 

ETL GISSUB: Connecting, Transforming and Automating Subsea Infrastructure Data

  • 1. CONNECT. TRANSFORM. AUTOMATE. ETL GISSUB Alessandro da Silva Civil Engineer and GIS Analyst
  • 2. Summary 1.  ABOUT PETROBRAS 2.  WHAT DOES GEODESY DEPARTMENT DO? 3.  SGO 4.  ETL 5.  GISSUB 6.  IN PROGRESS 7.  QUESTIONS CONNECT. TRANSFORM. AUTOMATE.
  • 3. PETROBRAS PETROBRAS EXPLORATION AND PRODUCTION E&P SERVICES SUBSEA SERVICES UNIT GEODESY DIVISION !  PETROBRAS in numbers: •  5th biggest energy company in the world; •  Daily Production: 2.021.000 barrels/day +/- 2%; •  Frota de navios : 242 (56 da Petrobras); •  Dutos: 30.067km (rígidos e flexíveis); •  15 Refineries and 27 plants; •  We are at 28 countries; •  90% of production is from subsea wells. •  12 Vessels installing pipelines 24/7.
  • 5. SGO !  SGO is a system developed to process, store and share data related to subsea pipelines, equipments and platforms installed by Petrobras. !  Used for planing and safe execution of all offshore operations, avoiding accidents in facilities and reflexes for people and enviroment. !  Is CAD based – Started in 1995 (MicroStation). !  18.500 access in May 2014. !  Users in more than 300 vessels.
  • 6.
  • 8. ETL !  Why ETL? •  Create GIS tools in CAD (Queries, Searchs, Attributes, Topology...) is an arduous task; •  Keep a CAD based structure updated every day (44 dgn files in Campos Basin – 8 professionals); •  Backup in DVDs; •  More than one UTM zone; •  Build a structure to GIS systems; •  Data Validation (Geometry, Topology, attributes); •  Interoperability; •  Good data to build good solutions; •  Have more than visualization.
  • 9. ETL !  What does the ETL do? •  Extracts data from CAD; •  Transform them, doing all validations and creating geometries according to each element behavior; •  Loads them into a customized APDM (ArcGIS Pipeline Data Model – World Standar) Oracle Spatial Database.
  • 10. ETL
  • 11. ETL !  Requirements •  Treat each element (46) separately according to the engineering and connectivity rules (Anchors, Anchor Lines, Pipelines, Platforms, WCTs, Manifolds, Connectors...); •  Treat Cell elements; •  Improve security; •  Remove Microlines; •  Update the Database every day; •  Leave nothing behind; •  Keep removed features (history); •  Report the errors.
  • 12. ETL !  Around 130 rules; !  Some Rules: •  A regular Anchor connects to an Anchor Line; •  A regular connector is suppose to have at least two pieces of pipelines; •  A WCT has always to be in a well head; •  A PLET always connects a steel pipeline to a flexible one; •  There are no lines with less than 1 meter of length; •  Cathodic Protection, in SGO, just in steel pipelines.
  • 13. ETL DGN TO FFS - Workbench Takes 90 minutes to run
  • 15. ETL Anchor - Workbench Takes 10 minutes to run
  • 16. ETL Pipeline - Workbench Takes 49 minutes to run
  • 19. IN PROGRESS !  Connection among elements – Geometric Network
  • 20. IN PROGRESS !  Connecting other databases
  • 22. Thank You! !  Questions? !  For more information: !  Alessandro da Silva ale.silva.fototerra@petrobras.com.br !  Fototerra/Petrobras CONNECT. TRANSFORM. AUTOMATE.