SlideShare una empresa de Scribd logo
1 de 26
HOW TO HANDLE DEV & TEST & PROD IN THE
CLOUD FOR ORACLE DATA INTEGRATOR
Gürcan Orhan
Enterprise Data Warehouse Architect
Ekol Logistics - Turkey
18 May 2017
http://gurcanorhan.wordpress.com
gurcan_orhan
http://tr.linkedin.com/in/gurcanorhan
#Harmony17 18 MAY 2017
WHO AM I?+20 years of IT experience.
+14 years of DWH experience.
+10 years of Oracle Data Integrator experience.
+8 years of Oracle Warehouse Builder experience.
Sybase Power Designer, ERwin Data Modeler, SDDM
OBIEE, Cognos, Microstrategy, Business Objects, Qlikview, Tableau
IBM Data Stage, SAP Data Services, Informatica, etc…
Oracle Excellence Awards - Technologist of the Year 2011 :
Enterprise Architect
DWH & BI Chair : TROUG (Turkish Oracle User Group)
Published Customer Snapshot for NODI @Oracle.com
Published videos about ODI @Oracle.com
Published OTN Podcasts about
“Data Warehousing and ODI”
“ODI and the Evolution of Data Integration”
Lots of “2MTT”s
Articles in OTech Magazine, SearchSoftwareQuality.com
Annual panelist for ODTUG “Ask the Experts Panel : ODI”
Presenter in OOW since 2010 (7 times in a row ⭐ )
Presenter in many OUG conferences in globe
Presenter in various universities in Turkey
Ekol Germany
Warehousing
Solutions
begin with the
Kardelen
Facility
1996 2003 2010 2012 2014 2016
201520132011200820021990
Acquire STS
Int.
Transport
Ekol Bosnia
Ekol France
Ekol Greece
Ekol Ukraine Ekol Spain
Ekol Bulgaria
Ekol Czech
Rep.
Ekol Iran
Ekol PolandEkol Italy
Ekol Romania
Ekol HungaryAcquire
Unok/Unatsa
n
Rainbow
Replaced by
Quadro
(software)
Intermodal
operations Ro-Ro
operations
Established
Ekol Milestones
Headquarters
Ekol Locations
Current
countries
15 80
locations
201723
countries
92
locations
201831
countries
104
locations
201942
countries
122
locations
USA
CN
#Harmony17 18 MAY 2017
Overview
#Harmony17 18 MAY 2017
MY DEFINITION OF ODI
ODI (Oracle Data Integrator) is a tool,
that can talk,
or learn how to talk,
with any database system,
or any operating system,
in its own language.
This is the power of ODI.
#Harmony17 18 MAY 2017
AGENDA
#Harmony17 18 MAY 2017
ODI REPOSITORY ARCHITECTURE
MASTER REPOSITORY
 Information related to DB/OS connections
Contexts, Repositories, Logical Architecture
 Information related to ODI internal security
 Versions
#Harmony17 18 MAY 2017
ODI REPOSITORY ARCHITECTURE
WORK REPOSITORY
(DEVELOPMENT)
 Source / Staging / Target metadata
Models in Designer Navigator
 Projects and beneath : Folders, Interfaces,
Packages, Procedures, Variables, Sequences,
Knowledge Modules, User Functions
 Scenarios, Load Plans, Schedules
 All the logs related to execution
#Harmony17 18 MAY 2017
ODI REPOSITORY ARCHITECTURE
WORK REPOSITORY (EXECUTION)
 Scenarios
 Load Plans
 Schedules
 Execution Logs
#Harmony17 18 MAY 2017
CONTEXTS
KEY TO JOIN PHYSICAL ARCHITECTURE AND LOGICAL ARCHIT
SRC A
(dev)
SRC A
(prod)
SRC B
(dev)
SRC B
(prod)
SRC C
(prod)
Source-C
Source-B
Source-A
#Harmony17 18 MAY 2017
AGENDA
#Harmony17 18 MAY 2017
START-UP PROJECT : INITIAL ARCHITECTURE
DEV & TEST PROD
MASTER
Topology
Versionin
g
Security
DEV WORK
Models
Projects
Executio
n
EXEC
WORK
Executio
n
SRC A
(dev)
SRC B
(dev)
SRC A
(test)
SRC B
(test)
SRC A
(prod)
SRC B
(prod)
SRC C
(prod)
https://cloud.oracle.com/
en_US/data-integrator
#Harmony17 18 MAY 2017
START-UP PROJECT : MANUAL EXPORT-IMPORT
#Harmony17 18 MAY 2017
AGENDA
#Harmony17 18 MAY 2017
WE’RE ON PRODUCTION
We need
to make
some
changes…
#Harmony17 18 MAY 2017
ADMINS AT WORK
TEST & PROD* ContextDEV Context
MASTER
Topology
Versionin
g
Security
EXEC
WORK
Executio
n
DEV WORK
Models
Projects
Executio
n
EXEC
WORK
Executio
n
DEV WORK
Models
Projects
Executio
n
EXPORT
IMPORT
MASTER
Topology
Versionin
g
Security
* New
#Harmony17 18 MAY 2017
ADMINS AT WORK
DEV & TEST Context PROD* Context
EXEC
WORK
Executio
nEXPORT
IMPORT
DEV WORK
Models
Projects
Executio
n
MASTER
Topology
Versionin
g
Security
MASTER
Topology
Versionin
g
Security
Insert
manually
Insert
manually
#Harmony17 18 MAY 2017
AGENDA
#Harmony17 18 MAY 2017
MORE TESTERS IN TEAM
DEV & TEST Context PROD* ContextDEV
Context
TEST
Context
EXEC
WORK
Executio
nEXPORT
IMPORT
DEV WORK
Models
Projects
Executio
n
DEV WORK
Models
Projects
Executio
n
MASTER
Topology
Versionin
g
Security
MASTER
Topology
Versionin
g
Security
#Harmony17 18 MAY 2017
EXPORT-IMPORT WITH A PACKAGE
http://sonra.io/odi-automating-deployment-of-scenarios-in-oracle-data-integrator/
#Harmony17 18 MAY 2017
EXPORT-IMPORT WITH THE ODI SDK
for (Object scen : scenarioCollection) {
OdiScenario odiscen =(OdiScenario)scen ;
export.exportToXml(odiscen, ExportPath, OverWrite, RecursiveExport,
Encoding);
}for (String filename : XMLFiles) {
import.importObjectFromXml(
import.IMPORT_MODE_SYNONYM_INSERT_UPDATE, filename, true);
}
For(Object interface : interfaces) {
OdiInterface odiInt = (OdiInterface) interface;
String scenName = odiInt.getName();
OdiScenario newScen = gene.generateScenario(odiInt, scenName,
newVersion);
}
#Harmony17 18 MAY 2017
AGENDA
#Harmony17 18 MAY 2017
ENTERPRISE ARCHITECTURE
DEV Context TEST Context PRE-PROD*
Context
PROD* Context
DEV WORK
Models
Projects
Executio
n
EXEC
WORK
Executio
n
DEV WORK
Models
Projects
Executio
n
EXEC
WORK
Executio
n
MASTER
Topology
Versionin
g
Security
MASTER
Topology
Versionin
g
Security
MASTER
Topology
Versionin
g
Security
* New
#Harmony17 18 MAY 2017
ENTERPRISE ARCHITECTURE
DEV PROD*
DEV WORK
Models
Projects
Executio
n
EXEC
WORK
Executio
n
DEV WORK
Models
Projects
Executio
n
TEST PRE-PROD*
EXEC
WORK
Executio
n
HOTFIX*
DEV WORK
Models
Projects
Executio
n
SMOKE
EXEC
WORK
Executio
n
MASTER
Topology
Versionin
g
Security
MASTER
Topology
Versionin
g
Security
MASTER
Topology
Versionin
g
Security
#Harmony17 18 MAY 2017
http://gurcanorhan.wordpress.com
gurcan_orhan
http://tr.linkedin.com/in/gurcanorhan

Más contenido relacionado

La actualidad más candente

Oracle GoldenGate Roadmap Oracle OpenWorld 2020
Oracle GoldenGate Roadmap Oracle OpenWorld 2020 Oracle GoldenGate Roadmap Oracle OpenWorld 2020
Oracle GoldenGate Roadmap Oracle OpenWorld 2020
Oracle
 
Ebs 12.2 con9021_pdf_9021_0001
Ebs 12.2 con9021_pdf_9021_0001Ebs 12.2 con9021_pdf_9021_0001
Ebs 12.2 con9021_pdf_9021_0001
jucaab
 

La actualidad más candente (20)

All of the Performance Tuning Features in Oracle SQL Developer
All of the Performance Tuning Features in Oracle SQL DeveloperAll of the Performance Tuning Features in Oracle SQL Developer
All of the Performance Tuning Features in Oracle SQL Developer
 
Oracle Database Security
Oracle Database SecurityOracle Database Security
Oracle Database Security
 
Building Oracle BIEE (OBIEE) Reports, Dashboards
Building Oracle BIEE (OBIEE) Reports, DashboardsBuilding Oracle BIEE (OBIEE) Reports, Dashboards
Building Oracle BIEE (OBIEE) Reports, Dashboards
 
Oracle Security Presentation
Oracle Security PresentationOracle Security Presentation
Oracle Security Presentation
 
Multiple Flat Files(CSV) to Target Table in ODI12c(12.2.1.0.0)
Multiple Flat Files(CSV) to Target Table in ODI12c(12.2.1.0.0)Multiple Flat Files(CSV) to Target Table in ODI12c(12.2.1.0.0)
Multiple Flat Files(CSV) to Target Table in ODI12c(12.2.1.0.0)
 
The Future of Data Warehousing: ETL Will Never be the Same
The Future of Data Warehousing: ETL Will Never be the SameThe Future of Data Warehousing: ETL Will Never be the Same
The Future of Data Warehousing: ETL Will Never be the Same
 
Azure data factory security
Azure data factory securityAzure data factory security
Azure data factory security
 
Oracle data integrator 12c - getting started
Oracle data integrator 12c - getting startedOracle data integrator 12c - getting started
Oracle data integrator 12c - getting started
 
Intro to Azure Data Factory v1
Intro to Azure Data Factory v1Intro to Azure Data Factory v1
Intro to Azure Data Factory v1
 
FDMEE Scripting - Cloud and On-Premises - It Ain't Groovy, But It's My Bread ...
FDMEE Scripting - Cloud and On-Premises - It Ain't Groovy, But It's My Bread ...FDMEE Scripting - Cloud and On-Premises - It Ain't Groovy, But It's My Bread ...
FDMEE Scripting - Cloud and On-Premises - It Ain't Groovy, But It's My Bread ...
 
Oracle ERP Implementation_Genpact_V7.pptx
Oracle ERP Implementation_Genpact_V7.pptxOracle ERP Implementation_Genpact_V7.pptx
Oracle ERP Implementation_Genpact_V7.pptx
 
Database migration
Database migrationDatabase migration
Database migration
 
Obia11.1.1.10.1 installation and configuration on Unix platform
Obia11.1.1.10.1 installation and configuration on Unix platformObia11.1.1.10.1 installation and configuration on Unix platform
Obia11.1.1.10.1 installation and configuration on Unix platform
 
Observability for Data Pipelines With OpenLineage
Observability for Data Pipelines With OpenLineageObservability for Data Pipelines With OpenLineage
Observability for Data Pipelines With OpenLineage
 
Oracle GoldenGate Roadmap Oracle OpenWorld 2020
Oracle GoldenGate Roadmap Oracle OpenWorld 2020 Oracle GoldenGate Roadmap Oracle OpenWorld 2020
Oracle GoldenGate Roadmap Oracle OpenWorld 2020
 
Migration to Oracle Multitenant
Migration to Oracle MultitenantMigration to Oracle Multitenant
Migration to Oracle Multitenant
 
Introduction to Data Engineering
Introduction to Data EngineeringIntroduction to Data Engineering
Introduction to Data Engineering
 
Big data architectures and the data lake
Big data architectures and the data lakeBig data architectures and the data lake
Big data architectures and the data lake
 
Ebs 12.2 con9021_pdf_9021_0001
Ebs 12.2 con9021_pdf_9021_0001Ebs 12.2 con9021_pdf_9021_0001
Ebs 12.2 con9021_pdf_9021_0001
 
Data warehouse proposal
Data warehouse proposalData warehouse proposal
Data warehouse proposal
 

Destacado

Oracle data integrator project
Oracle data integrator projectOracle data integrator project
Oracle data integrator project
Amit Sharma
 
Oracle Data Integration Presentation
Oracle Data Integration PresentationOracle Data Integration Presentation
Oracle Data Integration Presentation
kgissandaner
 
PradeepVD_OracleCloudHCMTaleo_6.5 yrs_Exp
PradeepVD_OracleCloudHCMTaleo_6.5 yrs_ExpPradeepVD_OracleCloudHCMTaleo_6.5 yrs_Exp
PradeepVD_OracleCloudHCMTaleo_6.5 yrs_Exp
Pradeep VD
 
OBIA HR Analytics: Transform complex data into business decisions
OBIA HR Analytics: Transform complex data into business decisionsOBIA HR Analytics: Transform complex data into business decisions
OBIA HR Analytics: Transform complex data into business decisions
Arvind Purushothaman
 

Destacado (20)

Best Practices with ODI : Flexibility
Best Practices with ODI : FlexibilityBest Practices with ODI : Flexibility
Best Practices with ODI : Flexibility
 
ODI 11g in the Enterprise - BIWA 2013
ODI 11g in the Enterprise - BIWA 2013ODI 11g in the Enterprise - BIWA 2013
ODI 11g in the Enterprise - BIWA 2013
 
How to solve complex business requirements with Oracle Data Integrator?
How to solve complex business requirements with Oracle Data Integrator?How to solve complex business requirements with Oracle Data Integrator?
How to solve complex business requirements with Oracle Data Integrator?
 
Odi interview questions
Odi interview questionsOdi interview questions
Odi interview questions
 
Oracle data integrator project
Oracle data integrator projectOracle data integrator project
Oracle data integrator project
 
Veri Ambarı Nedir, Nasıl Oluşturulur?
Veri Ambarı Nedir, Nasıl Oluşturulur?Veri Ambarı Nedir, Nasıl Oluşturulur?
Veri Ambarı Nedir, Nasıl Oluşturulur?
 
Oracle Data Integration Presentation
Oracle Data Integration PresentationOracle Data Integration Presentation
Oracle Data Integration Presentation
 
Making Oracle Services work
Making Oracle Services workMaking Oracle Services work
Making Oracle Services work
 
Hitchhiker's Guide to free Oracle tuning tools
Hitchhiker's Guide to free Oracle tuning toolsHitchhiker's Guide to free Oracle tuning tools
Hitchhiker's Guide to free Oracle tuning tools
 
Obia Online Training
Obia Online TrainingObia Online Training
Obia Online Training
 
Migration Steps from OWB 2 ODI
Migration Steps from OWB 2 ODIMigration Steps from OWB 2 ODI
Migration Steps from OWB 2 ODI
 
PradeepVD_OracleCloudHCMTaleo_6.5 yrs_Exp
PradeepVD_OracleCloudHCMTaleo_6.5 yrs_ExpPradeepVD_OracleCloudHCMTaleo_6.5 yrs_Exp
PradeepVD_OracleCloudHCMTaleo_6.5 yrs_Exp
 
Incredible ODI tips to work with Hyperion tools that you ever wanted to know
Incredible ODI tips to work with Hyperion tools that you ever wanted to knowIncredible ODI tips to work with Hyperion tools that you ever wanted to know
Incredible ODI tips to work with Hyperion tools that you ever wanted to know
 
oracle data integrator training | oracle data integrator training videos | or...
oracle data integrator training | oracle data integrator training videos | or...oracle data integrator training | oracle data integrator training videos | or...
oracle data integrator training | oracle data integrator training videos | or...
 
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business Analytics
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business AnalyticsOracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business Analytics
Oracle BI Hybrid BI : Mode 1 + Mode 2, Cloud + On-Premise Business Analytics
 
Oracle SQL tuning with SQL Plan Management
Oracle SQL tuning with SQL Plan ManagementOracle SQL tuning with SQL Plan Management
Oracle SQL tuning with SQL Plan Management
 
Obia with odi
Obia with odiObia with odi
Obia with odi
 
Oracle Database Vault
Oracle Database VaultOracle Database Vault
Oracle Database Vault
 
OBIA HR Analytics: Transform complex data into business decisions
OBIA HR Analytics: Transform complex data into business decisionsOBIA HR Analytics: Transform complex data into business decisions
OBIA HR Analytics: Transform complex data into business decisions
 
Tableau Best Practices for OBIEE
Tableau Best Practices for OBIEETableau Best Practices for OBIEE
Tableau Best Practices for OBIEE
 

Similar a How to Handle DEV&TEST&PROD for Oracle Data Integrator

BALWANT SINGH_RESUME
BALWANT SINGH_RESUMEBALWANT SINGH_RESUME
BALWANT SINGH_RESUME
Balwant Singh
 
CV - English - Fabio Tassi
CV - English - Fabio TassiCV - English - Fabio Tassi
CV - English - Fabio Tassi
Fabio Tassi
 
Mohit Kalra 25th August
Mohit Kalra 25th AugustMohit Kalra 25th August
Mohit Kalra 25th August
mdk8989
 

Similar a How to Handle DEV&TEST&PROD for Oracle Data Integrator (20)

Delicious : EDQ, OGG and ODI over Exadata for Perfection
Delicious : EDQ, OGG and ODI over Exadata for PerfectionDelicious : EDQ, OGG and ODI over Exadata for Perfection
Delicious : EDQ, OGG and ODI over Exadata for Perfection
 
BALWANT SINGH_RESUME
BALWANT SINGH_RESUMEBALWANT SINGH_RESUME
BALWANT SINGH_RESUME
 
Cv
CvCv
Cv
 
FAISAL SULEMAN_CV
FAISAL SULEMAN_CVFAISAL SULEMAN_CV
FAISAL SULEMAN_CV
 
The Reconstitution of Middleware with APIs V2
The Reconstitution of Middleware with APIs V2The Reconstitution of Middleware with APIs V2
The Reconstitution of Middleware with APIs V2
 
apidays LIVE New York 2021 - The reconstitution of middleware with APIs by As...
apidays LIVE New York 2021 - The reconstitution of middleware with APIs by As...apidays LIVE New York 2021 - The reconstitution of middleware with APIs by As...
apidays LIVE New York 2021 - The reconstitution of middleware with APIs by As...
 
Resume chella 29th march 2017
Resume chella 29th march 2017Resume chella 29th march 2017
Resume chella 29th march 2017
 
Workshop About Software Engineering Skills 2019
Workshop About Software Engineering Skills 2019Workshop About Software Engineering Skills 2019
Workshop About Software Engineering Skills 2019
 
Resume - RK
Resume - RKResume - RK
Resume - RK
 
Giancarlo Ronci eng
Giancarlo Ronci engGiancarlo Ronci eng
Giancarlo Ronci eng
 
ShreoshiRaha_CV
ShreoshiRaha_CVShreoshiRaha_CV
ShreoshiRaha_CV
 
Scaling DevSecOps Culture for Enterprise
Scaling DevSecOps Culture for EnterpriseScaling DevSecOps Culture for Enterprise
Scaling DevSecOps Culture for Enterprise
 
CV - English - Fabio Tassi
CV - English - Fabio TassiCV - English - Fabio Tassi
CV - English - Fabio Tassi
 
Cloud-Native .Net des applications containerisées .Net sur Linux, Windows e...
 Cloud-Native .Net des applications containerisées .Net sur Linux, Windows e... Cloud-Native .Net des applications containerisées .Net sur Linux, Windows e...
Cloud-Native .Net des applications containerisées .Net sur Linux, Windows e...
 
Jawad's Resume
Jawad's ResumeJawad's Resume
Jawad's Resume
 
Agile Mëtteg series session 7
Agile Mëtteg series session 7Agile Mëtteg series session 7
Agile Mëtteg series session 7
 
Crossing the low-code and pro-code chasm: a platform approach
Crossing the low-code and pro-code chasm: a platform approachCrossing the low-code and pro-code chasm: a platform approach
Crossing the low-code and pro-code chasm: a platform approach
 
INTERFACE, by apidays - Crossing the low-code and pro-code chasm: a platform...
INTERFACE, by apidays  - Crossing the low-code and pro-code chasm: a platform...INTERFACE, by apidays  - Crossing the low-code and pro-code chasm: a platform...
INTERFACE, by apidays - Crossing the low-code and pro-code chasm: a platform...
 
SACON NY 19: "Creating an effective developer experience for cloud-native apps"
SACON NY 19: "Creating an effective developer experience for cloud-native apps"SACON NY 19: "Creating an effective developer experience for cloud-native apps"
SACON NY 19: "Creating an effective developer experience for cloud-native apps"
 
Mohit Kalra 25th August
Mohit Kalra 25th AugustMohit Kalra 25th August
Mohit Kalra 25th August
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 

How to Handle DEV&TEST&PROD for Oracle Data Integrator

  • 1. HOW TO HANDLE DEV & TEST & PROD IN THE CLOUD FOR ORACLE DATA INTEGRATOR Gürcan Orhan Enterprise Data Warehouse Architect Ekol Logistics - Turkey 18 May 2017 http://gurcanorhan.wordpress.com gurcan_orhan http://tr.linkedin.com/in/gurcanorhan
  • 2. #Harmony17 18 MAY 2017 WHO AM I?+20 years of IT experience. +14 years of DWH experience. +10 years of Oracle Data Integrator experience. +8 years of Oracle Warehouse Builder experience. Sybase Power Designer, ERwin Data Modeler, SDDM OBIEE, Cognos, Microstrategy, Business Objects, Qlikview, Tableau IBM Data Stage, SAP Data Services, Informatica, etc… Oracle Excellence Awards - Technologist of the Year 2011 : Enterprise Architect DWH & BI Chair : TROUG (Turkish Oracle User Group) Published Customer Snapshot for NODI @Oracle.com Published videos about ODI @Oracle.com Published OTN Podcasts about “Data Warehousing and ODI” “ODI and the Evolution of Data Integration” Lots of “2MTT”s Articles in OTech Magazine, SearchSoftwareQuality.com Annual panelist for ODTUG “Ask the Experts Panel : ODI” Presenter in OOW since 2010 (7 times in a row ⭐ ) Presenter in many OUG conferences in globe Presenter in various universities in Turkey
  • 3. Ekol Germany Warehousing Solutions begin with the Kardelen Facility 1996 2003 2010 2012 2014 2016 201520132011200820021990 Acquire STS Int. Transport Ekol Bosnia Ekol France Ekol Greece Ekol Ukraine Ekol Spain Ekol Bulgaria Ekol Czech Rep. Ekol Iran Ekol PolandEkol Italy Ekol Romania Ekol HungaryAcquire Unok/Unatsa n Rainbow Replaced by Quadro (software) Intermodal operations Ro-Ro operations Established Ekol Milestones
  • 5. #Harmony17 18 MAY 2017 Overview
  • 6. #Harmony17 18 MAY 2017 MY DEFINITION OF ODI ODI (Oracle Data Integrator) is a tool, that can talk, or learn how to talk, with any database system, or any operating system, in its own language. This is the power of ODI.
  • 7. #Harmony17 18 MAY 2017 AGENDA
  • 8. #Harmony17 18 MAY 2017 ODI REPOSITORY ARCHITECTURE MASTER REPOSITORY  Information related to DB/OS connections Contexts, Repositories, Logical Architecture  Information related to ODI internal security  Versions
  • 9. #Harmony17 18 MAY 2017 ODI REPOSITORY ARCHITECTURE WORK REPOSITORY (DEVELOPMENT)  Source / Staging / Target metadata Models in Designer Navigator  Projects and beneath : Folders, Interfaces, Packages, Procedures, Variables, Sequences, Knowledge Modules, User Functions  Scenarios, Load Plans, Schedules  All the logs related to execution
  • 10. #Harmony17 18 MAY 2017 ODI REPOSITORY ARCHITECTURE WORK REPOSITORY (EXECUTION)  Scenarios  Load Plans  Schedules  Execution Logs
  • 11. #Harmony17 18 MAY 2017 CONTEXTS KEY TO JOIN PHYSICAL ARCHITECTURE AND LOGICAL ARCHIT SRC A (dev) SRC A (prod) SRC B (dev) SRC B (prod) SRC C (prod) Source-C Source-B Source-A
  • 12. #Harmony17 18 MAY 2017 AGENDA
  • 13. #Harmony17 18 MAY 2017 START-UP PROJECT : INITIAL ARCHITECTURE DEV & TEST PROD MASTER Topology Versionin g Security DEV WORK Models Projects Executio n EXEC WORK Executio n SRC A (dev) SRC B (dev) SRC A (test) SRC B (test) SRC A (prod) SRC B (prod) SRC C (prod) https://cloud.oracle.com/ en_US/data-integrator
  • 14. #Harmony17 18 MAY 2017 START-UP PROJECT : MANUAL EXPORT-IMPORT
  • 15. #Harmony17 18 MAY 2017 AGENDA
  • 16. #Harmony17 18 MAY 2017 WE’RE ON PRODUCTION We need to make some changes…
  • 17. #Harmony17 18 MAY 2017 ADMINS AT WORK TEST & PROD* ContextDEV Context MASTER Topology Versionin g Security EXEC WORK Executio n DEV WORK Models Projects Executio n EXEC WORK Executio n DEV WORK Models Projects Executio n EXPORT IMPORT MASTER Topology Versionin g Security * New
  • 18. #Harmony17 18 MAY 2017 ADMINS AT WORK DEV & TEST Context PROD* Context EXEC WORK Executio nEXPORT IMPORT DEV WORK Models Projects Executio n MASTER Topology Versionin g Security MASTER Topology Versionin g Security Insert manually Insert manually
  • 19. #Harmony17 18 MAY 2017 AGENDA
  • 20. #Harmony17 18 MAY 2017 MORE TESTERS IN TEAM DEV & TEST Context PROD* ContextDEV Context TEST Context EXEC WORK Executio nEXPORT IMPORT DEV WORK Models Projects Executio n DEV WORK Models Projects Executio n MASTER Topology Versionin g Security MASTER Topology Versionin g Security
  • 21. #Harmony17 18 MAY 2017 EXPORT-IMPORT WITH A PACKAGE http://sonra.io/odi-automating-deployment-of-scenarios-in-oracle-data-integrator/
  • 22. #Harmony17 18 MAY 2017 EXPORT-IMPORT WITH THE ODI SDK for (Object scen : scenarioCollection) { OdiScenario odiscen =(OdiScenario)scen ; export.exportToXml(odiscen, ExportPath, OverWrite, RecursiveExport, Encoding); }for (String filename : XMLFiles) { import.importObjectFromXml( import.IMPORT_MODE_SYNONYM_INSERT_UPDATE, filename, true); } For(Object interface : interfaces) { OdiInterface odiInt = (OdiInterface) interface; String scenName = odiInt.getName(); OdiScenario newScen = gene.generateScenario(odiInt, scenName, newVersion); }
  • 23. #Harmony17 18 MAY 2017 AGENDA
  • 24. #Harmony17 18 MAY 2017 ENTERPRISE ARCHITECTURE DEV Context TEST Context PRE-PROD* Context PROD* Context DEV WORK Models Projects Executio n EXEC WORK Executio n DEV WORK Models Projects Executio n EXEC WORK Executio n MASTER Topology Versionin g Security MASTER Topology Versionin g Security MASTER Topology Versionin g Security * New
  • 25. #Harmony17 18 MAY 2017 ENTERPRISE ARCHITECTURE DEV PROD* DEV WORK Models Projects Executio n EXEC WORK Executio n DEV WORK Models Projects Executio n TEST PRE-PROD* EXEC WORK Executio n HOTFIX* DEV WORK Models Projects Executio n SMOKE EXEC WORK Executio n MASTER Topology Versionin g Security MASTER Topology Versionin g Security MASTER Topology Versionin g Security
  • 26. #Harmony17 18 MAY 2017 http://gurcanorhan.wordpress.com gurcan_orhan http://tr.linkedin.com/in/gurcanorhan

Notas del editor

  1. JDBC URLs, user names and passwords used to connect to the different systems, LDAP connectivity information, and schemas where data can be found. In fact, all the information that is managed with the Topology navigator. Security, authentication management : ODI users names and passwords, ODI users privileges and profiles, profiles definition. When a new version of an object is created in the ODI studio.
  2. There are also Work Repositories that are labeled “Execution” Work Repositories. These can be used in production environments to make sure that source code will not be modified hastily in a live environment.
  3. Contexts are the keys which merges Logical Architecture with Physical Architecture depending on the defined contexts. Each Logical entity has physical connections related to each context.
  4. Simple architecture when starting up a project. Limited developers (1-5) with limited testers (1-3) with an admin or none. Up to 50 business users with limited power users (for UAT). Initial state
  5. Developers count increased to 10 Testers wants to make tests on production environment with live data. Simple UAT with power users on the production environment. *** PROD Context has encrypted password, which only supervisor can change.
  6. Admins don’t want developers and testers to have access to production systems. UAT activity is still made on production environment by business power users. PROD Context has encrypted password, which only supervisor can change.
  7. More admins, more testers and more developers hired. Changes need to be in a simple architecture from DEV to TEST and TEST to PROD. UAT is still in production with more business power users.
  8. More admins, more testers and more developers hired. Changes need to be in a simple architecture from DEV to TEST and TEST to PROD. UAT is still in production with more business power users. Uli Bethke
  9. More admins, more testers and more developers hired. Changes need to be in a simple architecture from DEV to TEST and TEST to PROD. UAT is still in production with more business power users.
  10. External source control for the hotfix environment.