Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
The Cloud as a Platform - By Jinesh Varia
1.
2. Amazon’s Three Businesses Consumer (Retail) Business Tens of millions of active customer accounts Seven countries: US, UK, Germany, Japan, France, Canada, China Seller Business Sell on Amazon websites Use Amazon technology for your own retail website Leverage Amazon’s massive fulfillment center network IT Infrastructure Business Cloud computing infrastructure for hosting web-scale solutions Hundreds of thousands of registered customers
5. Lowers Cost Eliminates Capital Investment Reduces Operational Costs Increases Agility Reduces Time to Market Removes constraints Foundation for 21 st Century Architectures Removes the “Heavy Lifting” Leverages Scalability, Reliability and Security KEY BENEFITS TO RUNNING IN THE AWS CLOUD
6.
7. And pace accelerates in 2010…. » Amazon RDS Read Replicas » Suse EC2 Linux » Amazon SNS Console » Amazon ELB HTTPS » AWS Free Tier » EMR Resizing Cluster » RDS Reserved » CloudFront Default Root » Startup Challenge 2010 » CloudFront Invalidation » CloudFront HTTPS » NYC Edge Location » Lowers Pricing HTTP » AWS Import Export GA » Amazon SNS » Amazon S3 Console » Amazon EBS CloudWatch » Amazon SNS » Combined AWS Data Transfer Savings » Amazon EMR Bootstrap Actions » Amazon ELB Session Stickiness » Amazon RDS in EU » New Singapore Region » EMR JobFlow Debugging » Simple DB Consistent Reads » Simple DB Conditional Puts » VPC in EU » Amazon RDS in US-west » Amazon CloudFront Access Logs » Amazon RDS Multi-AZ » Amazon S3 RRS » Amazon RDS Console » Amazon SQS Longer retention, Free Tier Amazon S3 Bucket Policies » Amazon VPC IP Address » Cluster Compute Instances » Amazon S3 RRS Notifications » Lowered Pricing EC2 » AWS IAM » Amazon VPC Console » Micro Instances » Amazon Linux AMI » Amazon EC2 Tagging, Filtering, Idempotency, » Oracle Certified AWS » AWS PHP SDK » Amazon S3 Lowered Pricing » CloudFront GA, SLA » S3 Multipart » GPGPU Instance Types » ISO27001/2 Certification » AWS Elastic Beanstalk » Amazon Simple Email Service » Improved AWS Support “Bronze” » Amazon CloudWatch Console » AWS CloudFormation » Amazon S3 Static Websites » AWS IAM Website Login » Paris Edge Location » VM Connector » Tokyo Region » AWS Support JP » Amazon EC2 Reserved Instances with Windows, Extra Large High Memory Instances » Amazon S3 Versioning Feature » Consolidated Billing for AWS » Lower pricing for Outbound Data Transfer » AWS Java SDK » Windows BYOL » Singapore Pop » CloudFront Private Streaming » Free Monitoring EC2 » Amazon Route 53 » PCI DSS Level 1 Certification » Mobile SDKs (Android, iPhone) » Large Object S3 Support » Florida POP » Import/Export APAC » New VPC » Dedicated Instances » Windows 2008 R2
8. Each day, AWS adds the equivalent server capacity to power Amazon when it was a global, $2.76B enterprise (circa 2000)
9. The “Living” AWS Cloud Low-level building blocks High-level building blocks Tools to access services Cross Service features
11. Can use any Programming Model, Language or Operating System or Database Can use any service individually or in any combination Can use as much or as little and only pay for what was consumed Can use any existing System Management Tools and extend the datacenter into the Cloud Flexibility is the key
12. Flexibility with Certified Licenses - BYOL Microsoft Exchange Server, Microsoft SharePoint Server, Microsoft SQL Standard Server, Microsoft SQL Enterprise Server, Microsoft Lync Server, Microsoft System Center servers, and Microsoft Dynamics CRM through License Mobility Software Assurance Oracle fully supports Oracle E-Business Suite, Oracle’s PeopleSoft Enterprise, Oracle’s Siebel CRM, Oracle Fusion Middleware, Oracle Database, and Oracle Linux on the portion of AWS EC2 which uses Oracle VM. SAP® solutions, including SAP® Rapid Deployment solutions and SAP® BusinessObjects™ solutions, IBM DB2, Informix, Lotus® Forms Turbo, WebSphere® Application Server, WebSphere® sMash, WebSphere Portal Server, Lotus® Web Content Management Standard Edition , InfoSphere Information Server, Lotus Domino®, Lotus Web Content Management Standard Edition®, Tivoli Monitoring®
13. US West (Northern California) US East (Northern Virginia) Europe West (Dublin) Asia Pacific Region (Singapore) Ashburn, Dallas, Los Angeles, Miami, Newark, Palo Alto, Seattle, St. Louis, Amsterdam, Dublin, Frankfurt, London, Hong Kong, Singapore, Tokyo, New York, Paris Amazon CloudFront Edge Locations Asia Pacific Region (Japan)
16. Platform that provides foundation to build innovation solutions on top Platform that provides abstraction to hide underlying layers (hardware and software) Platform that is self-service
19. AWS Master Node Input S3 bucket Output S3 bucket Amazon S3 Input dataset output results Start From IDE Command line Web Console End Notify Get Results Input Data Amazon EC2 Instances
20. Wall Street & Amazon EC2 Number of EC2 Instances 300 CPU’s on weekends Thursday 4/23/2009 Friday 4/24/2009 Sunday 4/26/2009 Monday 4/27/2009 Tuesday 4/28/2009 Saturday 4/25/2009 Wednesday 4/22/2009 3000- - 300 --
21. 500 Hours 1 Job, 1 Machine, 500 hours 1 Job, 500 Machines, 1 hour One Hour $1500 $260 To rack and stack on-premise For 3 years (reserved 100% utilized)
25. #2 Elasticity is the fundamental property of the cloud
26. Elasticity + Auto Scaling Infrastructure Cost $ time Large Capital Expenditure You just lost customers Predicted Demand Traditional Hardware Actual Demand Cloud Automated Elasticity
27.
28. Automate Using Cloud APIs Mr. Automate Development Monitoring Management Logistics Deployment
29. Build a Web application that sleeps at night or shrinks itself when there are no users accessing it
30. Build a Web application that Follows the Sun and leverages the true power of on-demand elasticity and globally dispersed regions
31. US-West-1b RDS Multi-AZ US-West Auto Scaling group : Web App Tier RDS Master US East Traffi c US West Traffic ELB Geo IP/Directional DNS Server Asia Traffic DNS CNAME Software-based Data Replicator Europe Traffic US-East-1b RDS Multi-AZ US-East Auto Scaling group : Web App Tier RDS Master ELB EU-West-1b RDS Multi-AZ EU-West Auto Scaling group : Web App Tier RDS Master ELB AP-SOUTHEAST-1b RDS Multi-AZ AP-SOUTHEAST Auto Scaling group : Web App Tier RDS Master ELB Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App Web App
35. 350,000 Minutes (7-8 Months) Time to provision a server in an enterprise Time to provision a server in the cloud <5 Minutes $1000 To rack and stack on-premise $260 For 3 years (reserved 100% utilized)
36.
37.
38.
39.
40.
41.
42.
43.
44.
45.
46.
47. New ways to purchase EC2 Instances Cloud HPC: Cluster Compute Instance 2 Xeon quad-core + 2 tesla NVIDIA GPGPU + 22GB + 10G non-blocking Ethernet
50. Elastic Supercomputer Distributed Processing Framework On-demand Infrastructure (Cloud) + Automation Each VM = 2 Xeon “ Nehalem” Quad-core with 10G Ethernet & 2 GPGPUs Cost savings due to lower “Spot price” (for Time-insensitive tasks) Expand or Shrink a running cluster Big Data power house
55. Scale: 50 servers to 5000 servers in 3 days Number of EC2 Instances 4/12/2008 Launch of Facebook modification. Amazon EC2 easily scaled to handle additional traffic Peak of 5000 instances 4/14/2008 4/15/2008 4/16/2008 4/18/2008 4/19/2008 4/20/2008 4/17/2008 4/13/2008 Steady state of ~40 instances “ Techcrunched”
63. Amazon VPC AWS Region Public Subnet Private Subnet Corporate data center Corporate Headquarters Availability Zone 1 Availability Zone 2 Branch Offices VPN Gateway Customer Gateway Internet Gateway Router DirectConnect Location Amazon S3 Amazon SimpleDB Amazon SES Amazon SQS New Enterprise IT Network architecture 10G
64. VPC is part of the Autodesk internal network Source: Autodesk
67. The Automation You Always Meant to Build Provision and attach 1TB of storage in 2 minutes (from the back of an auto-rickshaw in India). 10 new Linux servers in 2 minutes (while sitting by the pool on a nice day). Monitoring server resources from an iPhone (in a bar).
68. As of November 2010, Amazon.com’s Web Server Fleet is serving all the traffic from Amazon EC2
73. Amazon S3 Momentum 2 years ago Peak Requests: 70,000 per second 200 Million 5 Billion 18 Billion 52 Billion Total Number of Objects Stored in Amazon S3 Q1 2009
74. The Cloud Scales: Amazon S3 Growth Peak Requests: 370,000+ per second Total Number of Objects Stored in Amazon S3 2.9 Billion 14 Billion 40 Billion 102 Billion 566 Billion 262 Billion
80. In the Cloud, Security is a Shared Responsibility SAS 70 Type II Audit ISO 27001/2 Certification PCI DSS 2.0 Level 1-5 HIPAA/SOX Compliance FISMA A&A Low Enforce IAM policies Use MFA, VPC, Leverage S3 bucket policies, EC2 Security groups, EFS in EC2 Etc.. Encrypt data in transit Encrypt data at rest Protect your AWS Credentials Rotate your keys Secure your application How we secure our infrastructure What security options and features are available to you? How can you secure your application and what is your responsibility?
81. Industry-specific clouds : GovCloud – US Recovery.gov and Treasury.gov First government-wide system to move to the cloud Savings of over $750,000 in current budget cycle “ Cloud computing strikes me as a perfect tool to help achieve greater transparency and accountability. Moving to the cloud allows us to provide better service at lower costs. I hope this development will inspire other government entities to accelerate their own efforts. The American taxpayers would be the winners.’’ - Earl E. Devaney, the Board’s Chairman.
88. The “Living and Evolving” AWS Cloud Low-level building blocks High-level building blocks Tools to access services Cross Service features
89. The “Living and Evolving” AWS Cloud Low-level Infrastructure building blocks High-level Infrastructure building blocks Tools to access services Cross Service features
98. #2 Elasticity, Cost reduction and Agility are the main reasons to move to the cloud and AWS provides all three #1 Flexibility is very important when you choose the cloud and AWS provides the flexibility you need #3 In the Cloud, Security is shared responsibility. AWS provides the certifications, features and guidance #4 The Cloud is much more than its services. Its all about the Ecosystem #5 Start playing with it now. Talk to us. Be the leader in Brazil
Cloud landscape is dramatically changing every day and Cloud is changing the way we do business today. How we procure hardware, How we design and architect applications, how we secure applications and how we deploy applications. Best way to learn about the cloud is to how others are using it. So I am going to discuss how the cloud is being used as a platform.
To understand why there’s all this excitement, it’s helpful to look at analogies of some major changes that have occurred in other industries over time. Here’s a picture of our CEO at the museum of a beer manufacturing facility in Belgium. This is their electric generator that they used over 100 years ago. There was no electric grid or utility industry then. If you wanted electricity, you made it yourself. That probably seemed very natural at the time – but I guarantee you that making their own electricity didn’t make their beer taste any better. Well, a couple decades later, the electric grid sprang up, and companies stopped making their own electricity; that was a fundamental shift in how they consumed one of their major inputs, and this freed them up to focus on things that likely mattered a lot more to their customers – like the beer. We think the chance exists for the company-owned data center to undergo just as fundamental a transformation over the coming years, as companies realize that they don’t necessarily have to be experts in this. People are now starting to glimpse that future, and find it pretty exciting.
This is highly relevant in the cloud world because innovation is happening at break neck speed…..
Make a joke…. Cannot fit in one slide…..anymore so (show next slide) 11/2, Amazaon S3 price reduction 10/21, AWS Free Usage Tier 10/20, Resizable Elastic Map Reduce jobs 10/18,Feature Release,Mgmt Console adds support for Simple Notifications Service 10/14,Feature Release,Elastic Load Balancer termination of SSL certs 10/8,Feature Release,Mgmt console support for Amazon Relational Database Service DB Engine Version 10/6,Feature Release: Support for Suse Linux 10/6,Price Reduction,RDS 10/6,Feature Release,RDS Read Replicas 9/29,Feature Release,Download invoices 9/21,Feature Release,Amazon EC2 on the Oracle Virtual Machine and full Oracle Support, Certification and License portability 9/20,Feature Release,Resource tagging & associated features 9/17,Case Study,Matlab HPC benchmark 9/15,Feature Release,Amazon Linux 9/8,Feature Release,Mgmt console support for VPC 9/2,Price reduction,M2.2x & M2.4x 8/31,Case study,Authority to Operate-Appian BPM 8/25,General Announcement,Updated Security Whitepaper 8/24,Feature Release,Java SDK updated 8/17,Feature Release,RDS reserved instances 8/17,Feature Release,MySQL DB engine version mgmt 8/6,Feature Release,CloudFront Default Root Object 7/23,Opperational Change,Vulnerability Reporting and Pen Testing 7/16,Feature Release,Use your own kernel 7/15,Feature Release,Enhanced CF logs w/ Query strings 7/14,Feature Release,RRS in Mgmt Console 7/14,Feature Release,VPC IP address control & config file generation 6/29,Feature Release,RDS support of SSL
AWS does not force developers to use any particular programming model, language, or operating system. AWS does not force developers to use the entire suite of services - they can use any of our infrastructure services individually or in any combination. AWS does not limit developers to a pre-set amount of storage, bandwidth, or computing resources they can consume - they can use as much or as little as they wish, and only pay for what they use.
This is a real usage graph from one of our financial services customers during the last week of April (They have asked to remain anonymous for competitive reasons). Firms on Wall Street are finding EC2 an ideal environment to run many of their daily mission critical grid computing and cpu bound applications for a couple key reasons: 1/ Flexibilitythe ability to instantly access hundreds/thousands of cores increases the amount of data they can process, improving the overall quality of their models. and 2/ Cost efficiencies, as they can complete more of their processing for less total spend (Not paying for infrastructure during times of the day and weekends when its not needed) This wall street firm in particular has a nightly business process where they upload the day’s market trading data into S3, and then run proprietary ‘risk management’ algorithms. This lasts ~10 hours during week nights, where they ramp up to the equivalent 3000 m1.smalls. During the day and on weekends, they maintain a base of roughly 300 cores, to handle their always on work loads.
This slide applies to Amazon EC2, but just as easily describes Amazon S3’s value proposition.
In eclipsecon – a conference focussed on eclipse. They launched a contest for developers to build apps that will drive the lego mindstorm robot using APIs. There were 4X4 arena which collected and stored images in the cloud that shows the location
15 days was processed in 2 hours
Vimeo is about to come out with a case study. We are pushing for by the Summit, but if not you can remove the name and just use it as an example. They have 2 offerings: free and premium. The free case they want to minimize cost. They have the ability to have some delay in the service while they transcode the data. So, they set a maximum of $x on the amount they would pay for an hour, and use Spot for the task. If they haven’t gotten capacity in a long time, they choose to start in On-Demand. The premium case they want the media encoding to happen immediately. So, they purchase Reserved Instances to optimize their expected level of demand (note breakeven is around 30% utilization, so buying more RIs may make sense). Then, they use On-Demand for elasticity. If they can’t get the On-Demand when they need it, they try in Spot (e.g. you can get capacity not available anywhere else). In all, they have optimized for their SLA for the premium offering, and minimized cost in their free offering. Both are legitimate scenarios, and AWS is the only provider to support the pricing models to allow them to do it.
Remember TV’s without remote control. We had to walk up to the television set to change the channel or the volume. Now we have remote controls, we sit on our couch and control the hardware. Cloud APIs are remote control of the cloud hardware. You don’t have the need to walk up to server hardware.
There are several approaches to building a cloud strategy. We’ve seen customers from all size companies, from all industries get started with AWS in different ways Building a cloud strategy really depends on the companies needs. As a CIO or a manager reporting to the CIO, we recommend that you have a 2 part strategy for your Enterprise to get started in the cloud. For new applications, build and design new architectures with the cloud in mind. We have seen several customers like New York times who were quickly able to leverage some of cloud architecture patterns of implementing elasticity from ground up, loosely coupling etc. in other words, build a cloud-ready design from scratch. Just like greenfield applications can benefit from the cloud, existing application can too benefit from the cloud. For existing applications, we recommend building a migration plan, and transitioning application by application. This enables organizations to gain experience with the cloud as they begin to transition larger chunks of their infrastructure. When building this plan, you will notice that there are number of apps that are simply no-brainer to move to the cloud and can be moved very easily today. And other apps, they take methodical phased plan approach. This strategy has worked for several of our customers. Whether you are startup or an SMB or Large enterprise or an SI helping the customer, the strategy does not really need to change. We have noticed that when customers have followed the step by step phased planned approach - (some of which I will discuss in this presentation) and have invested time and resources towards building proof of concept projects, they clearly see the tremendous potential of AWS, and are able to leverage its strengths very quickly. And want to move other apps as well.
566b objects stored as of 10/3/2011 We will let our Numbers speak