8. Linux &
Windows
3D
sessions
O&G “Technical Cloud” Architecture
Collaborators,
Support staff
Access Resources
Self-Service Offering
End Users
Thin viewer
Visualization
Servers
HTTP(S)
HPC schdulers
HPC jobs
Developers,
Integrators
SOAP
DCV protocol
Storage
FC Hot Folder FileCatalyst protocol FileCatalyst Server
10. 5 Key benefits of the Technical Cloud
o Comprehensive, engineer-friendly experience
Web based, command line, seamless job and data correlation
o Boosts existing data management
Centralized, distributed, mixed, incremental transfers
o Hide the complexity of distributed systems
Multiple HPC schedulers, multiple clusters, batch and visualization
o Compatible with Mainstream ISV applications
Wrapping of HPC solvers, programmable APIs, full 3D management
o Ready for today’s complex Oil&Gas requirements
Standards based, SSO support, secure deployments, non-intrusive
11. Case Study: Global Oil Company
The engineers submit jobs from KL, Perth and other locations to Houston. The data sets vary
from 2GB to 5GB. They transfer such large files to Houston using Windows Explorer, submit
to the cluster and then copy back the results.
The engineers submit jobs from KL, Perth and other locations to Houston. The data sets vary
from 2GB to 5GB. They transfer such large files to Houston using Windows Explorer, submit
to the cluster and then copy back the results.
Houston
Data transfer can take hours and overload the corporate network Data transfer can take hours and overload the corporate network d duurriningg p peeaakk t timimee..
12. Improved User Workflow
1. User in KL/Perth submits ECLIPSE jobs through EnginFrame
– Input files are uploaded by EnginFrame Multiple File Upload Applet
through FileCatalyst
– Uploaded files are cached by EnginFrame
– INCLUDE/SLAVES statements are analyzed and uploaded
automatically
• Before upload occurs, the central cache is checked
• Cache is global for all the EnginFrame users, to maximize time savings
– FileCatalyst provides bandwidth control during peak hours
1. Job starts and results are incrementally copied back to
KL/Perth, while the job is running
– EnginFrame “job spooler” sync through FileCatalyst
– Unattended; no action required by the user
13. The Solution: EnginFrame + FileCatalyst
FileCatalyst accelerates and automates transfer of input and output files. It seamlessly
integrates with EnginFrame and eliminates most manual steps previously required.
The integration has considerably improved the ease of use and reliability of the workflows,
shortening time for each HPC iteration and reducing network usage and congestion.
FileCatalyst accelerates and automates transfer of input and output files. It seamlessly
integrates with EnginFrame and eliminates most manual steps previously required.
The integration has considerably improved the ease of use and reliability of the workflows,
shortening time for each HPC iteration and reducing network usage and congestion.
Houston
Web browser
FC Hot Folder
Server, Agent,
Cache .
FC Server
Data transfers went down Data transfers went down f rfroomm h hoouurrss t too s seeccoonnddss!!