The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Zero Downtime for Oracle E-Business Suite on Oracle Exalogic
Srini Chavali, Oracle Exalogic Product Management
Vivek Puri, Sherwin Williams
Hisham Salih, Amway
Gary Gordhamer, GE Power & Water
September, 2014
Presented with

3. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
3

4. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Program Agenda
E-Business Suite on Exa – Introduction
Sherwin Williams
Amway
GE Power & Water
Q & A
1
2
3
4
5
4

5. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Program Agenda
E-Business Suite on Exa – Introduction
Sherwin Williams
Amway
GE Power & Water
Q & A
1
2
3
4
5
5

6. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
E-Business Suite on Exa
•E-Business Suite is a critical application for many customers
•Downtime for patches and upgrades requires planning
•Planned downtime can be minimized with MAA architecture/practices
•MAA teams publish whitepapers (http://www.oracle.com/goto/maa)
•Pre 12.2 – patch as quickly as you can – WP available
•12.2 online patching – WP in progress
•Tech stack patches (database, 10.1.2, 10.1.3, WLS)
Maximum Availability Architecture - Introduction
6

7. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
E-Business Suite on Exa
• Deploy multiple load-balanced EBS application VMs on Exalogic
• Deploy EBS Shared Application Tier architecture
– Reduces patching/maintenance downtime
• Deploy EBS Parallel Concurrent Processing
– High performance / Fault tolerant
• Deploy EBS RAC database on Exadata
• Duplicate entire Prod site at DR site
– Replicate database changes via Data Guard
– Replicate App tier via ZFS replication
Maximum Availability Architecture - Recommendations
7

8. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
E-Business Suite on Exa
Maximum Availability Architecture
8
Primary data center
RAC DB on Exadata
RAC DB on Exadata
EBS app tier server farm on Exalogic
EBS app tier server farm on Exalogic
IB
IB
LB
LB
LB
LB
Data Guard
ZFS Replication
(ASM, Flashback)
Standby data center
Global LB

9. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
E-Business Suite on Exa
Maximum Availability Architecture – Site Transitions
9

10. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
10
Sherwin Williams (12.1.3, Virtual) Amway (12.1.3, Physical) GE Power & Water (12.2.3, Virtual)* - Introduction - Reasons for choosing EBS on Exa - Experience with EBS on Exa - EBS MAA architecture - MAA experience with EBS on Exa (Please hold all questions till the end !)

11. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Sherwin Williams
Vivek Puri
Manager, Database Administration
11

12. Vivek Puri
Zero Downtime for Oracle E-Business Suite
on Oracle Exalogic
Manager, Database Administration
& Engineered Systems

13. The Sherwin Williams Company
◆Largest Producer of Paint & Coatings in US, Top 3 worldwide
◆Founded in 1866, Cleveland, OH
◆2016 is 150th Anniversary
◆2013 - $10.19 billion in sales
◆Business in 120+ Countries
◆34,000+ employees
◆4,000+ Company Owned Stores
◆90+ Manufacturing Facilities Globally

14. Leading Sherwin Williams Brands

15. About myself
◆Extensive experience with Oracle Databases, E-Business Suite and related technologies
◆Member of Customer Advisory Board for Oracle EBS ATG and Exalogic
◆Master’s degree in Computer Science
◆18 years experience working on Oracle technologies
◆Worked as Lead DBA, Architect, EBS System Administrator, IT Manager
Vivek Puri
Manager – Database Administration & Engineered Systems
Email – vivek.puri@sherwin.com

16. Business/ Technical Drivers for Engineered Systems
Challenges
Complexity of using Veritas Clusterware with Solaris / Scalability
Poor performance of several business processes / R12 Upgrade / Clones
Improving time to market of solutions
Stability and Manageability with Engineered Architecture
Application Server Management:
Cost, time and effort related to Maintenance
Service level of upgrading and deploying new services

17. Business/ Technical Drivers for Engineered Systems
Consolidation
Magnitude of infrastructure reduction, impact on servers and licenses
Performance improvement of business processes
Provide opportunity to reduce management & administration costs
Optimize the workload of Oracle software / application
Sizing (Capacity available on-Demand)
Single vendor for support

18. Sherwin Williams EBS Footprint
Three Regional EBS Application Environments
◆Domestic (US/Canada R12.1.3)
–HR, Benefits (Global Employees Management Systems), OLM
–Financials (AP,GL, FA) ; Property Management; EAM
◆Latin America (ERP - R12.1.3 & VCP – R12.2)
–Financials (AP,AR,GL, FA) ; Property Management; EAM
–Supply Chain & Manufacturing (OM, OPM, WMS, ASCP); Demantra; iSupplier
◆Asia Pacific (R12.1.3)
–Financials (AP,AR,GL, FA)
–Supply Chain & Manufacturing (OM, OPM, WMS, ASCP)

19. Architecture EBS on Exadata & Exalogic
Database ClusterLatin America Oracle ERP Exadata X4-2 Half Rack (Oracle 12c Grid Infrastructure (CRS + ASM) Database - 11gR2 (11.2.0.3) 4 Node Cluster (DB – 2 Node RAC)) LA ERP Production ArchitectureLA ERP Production AppsTier vServers (Primary) APP2(16 CPU,64GB) APP4(16 CPU,64GB) APP3(16 CPU,64GB) APPDR3(16 CPU,64GB) APPDR1(16 CPU,64GB) APPDR4(16 CPU,64GB) APPDR2(16 CPU,64GB) External Middle TierAPPDR2X(8 CPU,16GB) External Middle Tier (Shared) APPDR1X(8 CPU,16GB) + + LA ERP Production AppsTier vServers (DR) Exalogic X3 – ½ RackOracle Linux 5.8OVM – 3.0Application Server PlatformInternal Middle TierInternal Middle TierAPP1X(8 CPU,16GB) APP2X(8 CPU,16GB) APP1(16 CPU,64GB) Database ClusterLatin America Oracle ERP Exadata X4-2 Half Rack (Oracle 12c Grid Infrastructure (CRS + ASM) Database - 11gR2 (11.2.0.3) 4 Node Cluster (DB – 2 Node RAC)) Application Server PlatformExalogic X3 – 1/4 RackOracle Linux 5.8OVM – 3.0WebTierConcurrentTierExternalTierWebTierConcurrentTierExternalTierPrimary SiteDR Site

20. Our Experience
◆Faster delivery to meet business needs
–Fully configured clustered hardware in 2 weeks
◆Direct performance benefit in R12 upgrade cycle
–Upgrade time reduced from ~ 200 hours (old H/W) to 65 hours (including Database platform migration to Exadata)
◆Managed the Application upgrade to R12 in 36 hours, by handling Database Platform migration ahead of schedule
◆Key business processes performance improved significantly
–Depreciation of 1M+ assets
Before: 20-24 hours execution time serially
 After: 4-5 hours execution time in parallel

21. Our Experience
◆Reduced backup and clones times dramatically
–Before: ~12 hours to perform backup and restore of 1 TB DB
–After: <60 minutes to perform backup and restore of 2 TB DB
–EBS Cloning time reduced to 6 hours from 24 hours
◆Comprehensive Patching
–Single application testing cycle
◆Significant performance improvements Demantra-ASCP
–Demantra weekend forecasting process time reduced to < 6 hours from 33 hours (phase1- Exadata) & to ~ 2 hours(phase2-Exalogic)

22. Our Experience
◆Performance improvement in various manufacturing & shipping processes
◆Reallocate resources to higher value-add activities
◆Direct benefit to the business with significant improvements in the month-end processes
◆Performance Improvements for OBIEE –
–ETL - Avg. 2X - 4X improvements
–Reporting - Avg. 4X - 10X improvements

23. Architecture Highly Available based on MAA guidelines

24. MAA Implementation
◆Virtualized Exalogic & Exadata connected over Infiniband
◆ZFS replication for Apps Tier, using Storage replication channel
◆Leveraging ASM for Database storage; optimized with redundancy
◆Using Flashback & DataGuard with MaxPerformance mode, DG Broker
◆Distributed Apps Tier, with load-balanced multiple servers for Web, Concurrent and External Tiers
◆Leveraging named network for IPoIB networks
◆Databases are RAC enabled for High Availability
◆F5 configuration replicated across, Primary and Secondary site

25. Advantages with MAA
◆Resiliency for Business Application
◆Fault tolerant fully redundant hardware
◆Business continuity, while handling unplanned outages
◆Virtualization on Apps Tier layer with Virtualized Exalogic
◆Maintenance in rolling manner, minimizes planned downtime
◆ZFS replication for Apps Tier allows for quick failover incase of disaster
◆With DataGuard the DB can be available at DR site with no data loss
◆Optimized configuration for Business Application, which is tested by specialized team and incorporates best practices

26. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Amway
Hisham Salih
Senior Apps DBA
26

27. Amway E-Business Suite
EXA Technology
September 2014
1
Hisham Salih

28. 28
About Amway
Amway is a leader in the direct selling industry
Located in Ada, Michigan
More than 100 countries and territories
More than 3 million Amway Business Owners
Revenue $ 11.8 billion

29. Amway’s Business and Technical Value of EXA
29
•Maximize labor force through business process efficiency
•Enable analytics to drive better business decisions
•Long term - High ROI
Business Value
•Maximum Availability Architecture
•Ability to scale globally
•Highly performing system
•Reduction in both planned / unplanned downtime
Technical Value
•Consolidate one global financial system
•Harmonize back-office business processes
•Establish global data definitions
ATLAS Project Scope

30. 30
Amway’s EBS Details
•Global financial solution running in Oracle EBS
•Orders, Distributors, Shipping and bonus transactions through SOA and WebMethod into Oracle EBS
•EBS Modules Usage: 60% Financial, 30% logistics, and 10% Order
•80% batch processing and 20% OLTP
0
500
1,000
1,500
2,000
2,500
3,000
Total Run Per Day
Sales Order Import Program
Pay On Receipt AutoInvoice
Auto Create Purchase Orders
Pick Selection List Generation - SRS
Layer Cost Worker
Cost Manager
Autoinvoice Master Program
Autoinvoice Import Program
Create Accounting
Accounting Program
0.00
50.00
100.00
150.00
200.00
250.00
300.00
Maximum Minutes Per Day
Sales Order Import Program
Pay On Receipt AutoInvoice
Auto Create Purchase Orders
Pick Selection List Generation - SRS
Layer Cost Worker
Cost Manager
Autoinvoice Master Program
Autoinvoice Import Program
Create Accounting
Accounting Program

31. Amway’s Exa Architecture
31
Dev / DR
Test
QA / DR
Production
•Run on Oracle E-Business 12.1.3 database 11.2.0.4
•Four ¼ RAC Exalogic
•Four ½ RAC Exadata
•Application instance two to 5 nodes
•Database instance two to four nodes (RAC)
ATLAS Architecture
ZFS 7420 120 TB Usable StorageInfiniBand 40 GBAmway Corporate Network Client Access 10GBClient Access 10GBClient Access 10GB 1/2 Rack Exadata1/4 Rack ExalogicDuplicate Configuration in Primary and Secondary Site

32. 32
Amway’s Experience with Exa
•Seamless Go-Live globally
•Seamless Integration between E-Business and Partner Systems
•Seamless closing financial books by the EOD and EOM
Business Experience
•Faster Batch Processing and online response time
•Less time spend by admin operations including database, EBS TechStack, apply patches, and cloning
•It is up and up and up
Technical Experience
Americas
Europe, India and Africa
Asia Pacific
Greater China
Our Markets

33. 33
Amway’s EXA MAA Architecture
Management Network 10GBAmway Corporate NetworkAmway Corporate NetworkSun ZFS Storage Replication over EthernetOracle Data Guard Over EthernetAmway Corporate WANInfiniBand 40GBInfiniBand 40GBSecondary DatacenterPrimary DatacenterAmway Global Site SelectorOAMDOMAIN.LOCAL Client Access 10GBClient Access 10GB

34. 34
•Operational Procedure
•Datacenter switch and HA
•Quarterly Releases
•RTO and RPO
ATLAS HA&DR Playbook
•High Redundancy with network site failure
•Less time and effort – instance datacenter switch
•Up Time
•RPO challenge
•Rolling DB patch and PSU constraints
HA and DR observations
Amway’s MAA EXA Experience

35. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
GE Power & Water
Gary Gordhamer
ERP Infrastructure Principal Technologist
35

36. Imagination at work.
GE P&W Exadata + Exalogic EBS 12.2

37. Speaker background
Gary Gordhamer
Principal Technologist ERP Infrastructure
Power & Water Technology
GE Power & Water
23 years of IT experience
22 years with Oracle (6.x up to 11g)
Worked in many different industries including healthcare, manufacturing, utilities, banking, and printing
Associate Editor

38. GE Power & Water Overview
Power Generation
Renewables
Nuclear
Multi Modal
Water
Services
Distributed Power
GE Power & Water provides a broad array of power generation, energy delivery, and water process technologies to solve our customers' challenges locally. We work in several areas of the energy industry, including renewable resources such as wind and solar, biogas and alternative fuels, and coal, oil, natural gas, and nuclear energy.
Headquartered in Schenectady, New York, Power & Water is GE’s largest industrial business, with nearly $25 billion in revenue in 2013 and approximately 40,000 employees across more than 700 locations globally.

39. Power & Water - EBS Journey
ERP reductions
‘12
40
37
‘13
28
’14E
20
’15F
7
’16F
83% reduction in ERPs
2015
Q3
Q4
Q3
Q4
Q1
Q2
2014
2016
Q3
Q4
Q1
Q2
PowerGeneration
Parts
FS
Dist. Power
Dresser
Aero
Jenbacher
Renewables
Exadata
+
Exalogic
Goals:
•Reduce number of ERP’s
•Move to R12.2
•Modern technology stack
•Highly available, reliable, with performance *Not shown, VCP, FMW SOA, etc…
400GB
250 Users
5TB
2,500 Users
2.5TB 1,000 Users
8TB 3,000 Users
2.5TB 1,000 Users

40. •2x ½ racks of Exadata
•2x ¼ racks of Exalogic
•2x racks of ZFS for backup
–Geographically different locations
–Separated by multiple states
What we installed
There are three main physical components to the design
Exadata – for database tier
Exalogic – for application tier
ZFS storage – for backup
These items directly map to the Oracle e-Business suite Architecture components

41. GE experience with EBS on Exadata/Exalogic
Lots of groups to work with inside of Oracle
•EBS team, Exadata hardware, Exalogic hardware, Database team, OVM team, EMCC team, etc…
Good engagement from sales and product teams to help with these interactions
Single support tickets, but lots of hand offs in the support process
Some growing pains as we are early adopter of EBS R12.2
•Cloning scripts / process not clear
•Issues with unique listeners needed for clone process and shared nature of Exadata, as well as multiple networks
•Exadata network ADMIN hostname vs. PUBLIC hostname
System performance has been very good to date (if we set things up right)

42. EBS on Exadata + Exalogic MAA design
Following Oracle MAA whitepaper
“Oracle E-Business Suite and Oracle Maximum Availability Architecture Best Practices” (April 2014)

43. GE EBS MAA procedures and experiences
New procedures for DR
•Exa* MAA designs are different than our traditional DR
Cleaning up a lot of MAA setup items in our ERP eco-system
•GRC product using SID vs. SERVICE_NAME
•FMW SOA using SID vs. GridLink connection
Getting people used to security model on Exadata
•Shared ASM, GRID user vs. dedicated servers per database
We expect to use Platinum Support / ASR gateway to enhance our uptime, speed response to issues, and stay updated on patches

44. GE EBS MAA vs. GE previous EBS Architecture
Our previous HA techniques were similar, we used general purpose storage replication for both database and application tiers.
•Since the Exa* stack facilitates a collapsed support team, the design and support is somewhat simplified.
•Our team is still getting up to speed on managing hardware end to end (storage, OS, Virtualization, network, cluster, etc…)
•The Oracle MAA solution lacks sufficient security and identity controls built in, so much of our time has been integrating these items into the design.
We will be working to script / automate more of our EBS instance build, cloning, and DR steps based on the MAA design.

45. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Program Agenda
E-Business Suite on Exa – MAA Introduction
Sherwin Williams – EBS on Exa MAA
Amway – EBS on Exa MAA
GE Power & Water – EBS on Exa MAA
Q & A
1
2
3
4
5
45

46. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Join Us for Other Exalogic Sessions
46
Session Title
Date
Location
Oracle Exalogic Roadmap: Hardware, Software, Platform News
Monday, 2:45 p.m. - 3:30 p.m.
Moscone South Room 270
VMware vs Oracle Exalogic: A Fair and Balanced Comparison
Monday, 5:15 p.m. - 6:00 p.m.
Moscone South Room 304
How to Deliver Oracle Fusion Middleware-as-a-Service to Your Organization
Monday, 4:00 p.m. - 4:45 p.m.
Moscone South Room 262
Zero Downtime for Oracle E-Business Suite on Oracle Exalogic
Tuesday, 3:45 p.m. - 4:30 p.m.
Moscone South Room 270
Customer Innovations on Oracle Engineered Systems
Wednesday, 11:30 a.m. - 12:15 p.m.
Moscone South Room 304
Building Application Private Clouds with Engineered Systems
Wednesday, 11:30 a.m – 12:15 pm
Moscone West - 3018
Building a Scalable Private Cloud with Oracle Exalogic, Nimbula, and Openstack
Wednesday, 4:45 p.m. - 5:30 p.m.
Moscone South Room 304
Exalogic Innovation Awards
Wednesday, 5:00 p.m. - 5:45 p.m.
Yerba Buena Lam Research Center
PeopleSoft High Performance & MAA Guidelines on Oracle Exalogic & Oracle Exadata
Thursday, 10:45 a.m. - 11:30 a.m.
Marriott Marquis Salon 14/15
Increasing Your Application Availability with Oracle Traffic Director
Thursday, 12:00 p.m. - 12:45 p.m.
Marriott Marquis Salon 14/15
Thriving with Oracle Exalogic: The Definitive Owner/Operator Lifecycle Handbook
Thursday, 12:00 p.m. - 12:45 p.m.
Moscone South Room 304
Oracle Exalogic, Oracle Solaris & Oracle SuperCluster: More Versatile Than Ever
Thursday, 1:15 p.m. - 2:00 p.m.
Moscone South Room 304
Unleashing Extreme Performance and Scalability on Oracle Exalogic Elastic Cloud
Thursday, 2:30 p.m. - 3:15 p.m.
Moscone South Room 200
Extreme SOA: Secure, Fast, Scalable and Reliable: Delivered on Oracle Exalogic
Thursday, 1:15 p.m. - 2:00 p.m.
Moscone South Room 200
Building Application Private Clouds with Engineered Systems
Wednesday, 11:30 a.m – 12:15 pm
Moscone West Room 3018

47. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
47
Questions
Visit us at
oracle.com/exalogic

48. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Join the Exalogic Community
48
Twitter
Facebook
Exalogic Blog
LinkedIn
YouTube
Visit us at: oracle.com/exalogic