Best Practices in the Cloud: Grid Computing
•Download as PPTX, PDF•
0 likes•1,595 views
This document discusses using grid computing in the cloud. It introduces RightGrid, a cloud-based grid computing platform from RightScale. The presentation covers how grid applications can leverage cloud infrastructure for back-end processing jobs. It demonstrates RightGrid's architecture using Amazon Web Services and shows how standard design patterns allow jobs to be submitted, processed by worker nodes, and retrieved. Examples of industries using grid computing in the cloud are provided. Benefits discussed include elastic scaling, on-demand access to resources, and a simple cost model.
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (16)
Similar to Best Practices in the Cloud: Grid Computing
Similar to Best Practices in the Cloud: Grid Computing (20)
More from RightScale
More from RightScale (20)
Recently uploaded
Recently uploaded (20)
Best Practices in the Cloud: Grid Computing
- 1. Best Practices in the Cloud: Grid Computing
- 2. Your Panel Today Presenting Thorsten von Eicken – Founder, CTO Josh Fraser – VP, Business Development David Welch – Sr. Sales Engineer Q&A Matthew Small – Sr. Account Manager
- 4. Grid Applications & the Cloud
- 6. Live Demo
- 7. Use Cases
- 8. Q&A – Getting Started
- 10. Grid Apps – Back-end Jobs Users Front-end web app “Complete” web site Simple submit/retrieve site Back-end grid Processes jobs “submitted”via web site Results “retrieved” via web site Job queue invisible to end user Grow/shrink workers tomaintain SLA Typical example: Multi-media processing/transcoding Web tier Grid tier
- 11. Grid Apps – Back-end Jobs Users Cloud effects Grow/shrink workers to maintain SLA Design, configure, manage all tiersin homogeneous infrastructure Communicate and share across tiers (database, storage, aux servers, …) Clone entire architecturefor dev & test Web tier Grid tier
- 12. Job submission Upload/submit Complex priority scheduler Cloud effects Variable number of nodes extend peak improve utilization On-demand vs. queue Personal grids Real-time grids Grid Apps – Queued Batch nodes time
- 13. Standard design pattern: Produce/upload data Queue work Worker array Queue results Consume/download results RightGridArchitecture 8
- 14. RightGrid Architecture Job Producer InputQueue ResultQueue Grid Workers Job Consumer web/app server web/app server user workstation user workstation Amazon EC2 Elastic Compute Cloud Amazon SQS Simple Queue Service Amazon S3 Simple Storage Service
- 15. RightGrid Demo Job Producer InputQueue ResultQueue Grid Workers Job Consumer EC2 server user workstation 1000 images 1000 work items 1..100 servers 1000 watermarked images 1000 result items
- 16. Standard worker server design pattern: Loop over items and do work Pull data descriptor in SQS, data in S3 Work … Push data data into S3, descriptor into SQS Audit audit record, log files RightGridWorker 11
- 17. RightGridWorker RightGrid Worker Server resultqueue pre- work post- work your code workqueue Results (S3) local disk Input (S3) auditqueue logs 12
- 18. “Hello world” worker script Worker array with 1 worker running Coordinator server submitting “Hello” units SQS queues RightGrid 1-click set-up
- 19. Pharmaceutical – Protein Analysis Executed 2.5 million compound comparisons Estimated one week of processing on internal servers Completed in a half day on 100 instances Insurance – Fraud Detection Multiple years of records processed for fraudulent or duplicate claims Estimated at weeks or months internally, or $M cap-ex Reduced to days and hours on the cloud Web 2.0 – Media Transcoding From images and music, transcode and render video on demand Produce high production videos within minutes instead of hours Grid Use Cases Today
- 20. Why the Cloud for Grid Apps? In-house Grid Cloud Grid Invest for peak Queue model Web/batch isolation Black-box jobs Complex charge-back Access “unlimited” resources On-demand model Easy web+batch mix Transparent resource access Simple cost equation Neutral cost equation 1000 Jobs 10 Machines 100 Elapsed Hours 1000 Jobs 100 Machines 10 Elapsed Hours same work same cost
- 21. RightGrid Benefits Standard proven architecture Worker framework ready to go Management thru RightScale interface Save Time, Improve Visibility
- 24. (866) 720 – 0208
- 25. Register for our next webinar and access live recordings of past webinars at:RightScale.com/webinars Thank you for listening!
- 26. Best Practices in the Cloud: Grid Computing
Editor's Notes
- Key benefits of the cloud:Infinite computing resourcesAvailable on-demandPay per useAccess via the InternetIn many ways surpassing traditional hosting:Multiple server sizes: ½ core to 8 coresReassign IPs / VIPsMultiple failure zonesDisk VolumesCloud interoperabilityMultiple geographiesRightScale automation tying it all together