Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.

AWS 101 Lunch and Learn Jan 2013

2.229 visualizaciones

Publicado el

Developing applications on Amazon Web Services (AWS) or moving your business into the cloud is more straightforward than you think. Whether you are a developer eager to learn new skills, a solutions architect who wants to solve existing technology problems, the IT professional who wants access to cost-effective, on-demand computing resources, this workshop is for you.

Publicado en: Empresariales
  • Amazon WS will change the world of business . The potential and possibilities of elastic computing power coupled with the reference model available on a global basis are endless. Access to Industry standard RBD's, APi's for everything and answering the main problem topic of security so skilfully and totally resolved. Love it
    ¿Estás seguro?    No
    Tu mensaje aparecerá aquí

AWS 101 Lunch and Learn Jan 2013

  1. 1. AWS 101Lunch & Learn Ryan Shuttleworth Technical Evangelist @ryanAWS
  2. 2. Agenda12:00 - 12:45 Presentation – AWS 101 Introducing the concepts behind AWS such as utility computing and elasticity12:45 - 13:00 Working lunch13:00 - 14:00 Presentation and Demonstration Live demonstration and interactive walkthrough
  3. 3. What we are going to cover Keypairs Amazon Machine Images Security groups S3 EC2 instances CloudFront Metadata service Elastic Load balancer Autoscaling RDS Feel free to follow along on your laptops
  4. 4. background
  5. 5. Consumer Seller IT Infrastructure Business Business Business Tens of millions of Sell on Amazon Cloud computing active customer websites infrastructure for accounts hosting web-scale Use Amazon solutions technology for your own retail website Eight countries: Hundreds of US, UK, Germany, Leverage Amazon’s thousands of Japan, France, massive fulfillment registeredCanada, China, Italy center network customers in over 190 countries
  6. 6. About AmazonHow did Amazon…Web Services Deep experience in building and ? operating global web scale systems …get into cloud computing?
  7. 7. Over 10 years in the makingEnablement of sellers on AmazonInternal need for scalable deployment environmentEarly forays proved developers were hungry for more
  8. 8. AWS Mission Enable businesses and developers to use webservices* to build scalable,sophisticated applications. *What people now call “the cloud”
  9. 9. Not excess capacity!
  10. 10. Each day AWS adds the equivalent servercapacity to power Amazon when it was a global, $5B enterprise
  11. 11. Each day AWS adds the equivalent servercapacity to power Amazon when it was a global, $5B enterprise 2003 $5.2B retail business 7,800 employees A whole lot of servers
  12. 12. Objects in S3 1.3 Trillion 835k peak transactions per second
  13. 13. EMR Jobs 3.7 M clusters launched since May 20104,000,0003,500,0003,000,0002,500,0002,000,0001,500,0001,000,000 500,000 0
  14. 14. Utility computing
  15. 15. Utility computingOn demand Pay as you goUniform Available
  16. 16. Utility computingOn demand Pay as you goUniform Available
  17. 17. Utility computing
  18. 18. Utility computingOn demand Pay as you go Compute Scaling Security CDN Backup DNS Database Storage Load Balancing Workflow Monitoring NetworkingUniform Messaging Available
  19. 19. On a global footprint Region US-WEST (N. California) EU-WEST (Ireland) GOV CLOUD ASIA PAC (Tokyo) US-EAST (Virginia)US-WEST (Oregon) ASIA PAC (Singapore) SOUTH AMERICA (Sao Paulo) ASIA PAC (Sydney)
  20. 20. On a global footprint Availability Zone
  21. 21. On a global footprint Edge Locations London(2) Seattle South Bend New York (3) Amsterdam (2) Newark Stockholm Dublin Palo Alto Tokyo (2)San Jose Frankfurt(2) Paris(2) Ashburn(2) Milan Madrid Osaka Los Angeles (2) Jacksonville Dallas(2) Hong Kong St.Louis Miami Singapore(2) Sydney Sao Paulo
  22. 22. At the end of a web serviceec2-run-instances ami-b232d0db ec2-run-instances ami-b232d0db --instance-count 3 --instance-count 5 --availability-zone eu-west-1a --availability-zone eu-west-1c --instance-type m1.small --instance-type m1.medium
  23. 23. At the end of a web service ec2-run-instances ami-b232d0db --instance-count 2 --availability-zone us-east-1d --instance-type m1.xlarge ec2-run-instances ami-b232d0db --instance-count 2 --availability-zone us-east-1b --instance-type m1.xlarge
  24. 24. At the end of a web service as-create-auto-scaling-group MyGroup ec2-authorize default -p 80 --launch-configuration MyConfig --availability-zones eu-west-1c --min-size 2 --max-size 200 elb-create-lb myLoadBalancer
  25. 25. and rich console services
  26. 26. Elasticity
  27. 27. Elastic capacity Traditional IT capacityCapacity Time Your IT needs
  28. 28. Elastic capacityOn and Off Fast GrowthVariable peaks Predictable peaks
  29. 29. Elastic capacity WASTEOn and Off Fast GrowthVariable peaks Predictable peaks CUSTOMER DISSATISFACTION
  30. 30. Elastic capacityCapacity Traditional IT capacity Elastic cloud capacity Time Your IT needs
  31. 31. Elastic capacityOn and Off Fast GrowthVariable peaks Predictable peaks
  32. 32. 503Service Temporarily UnavailableThe server is temporarily unable to service your request due tomaintenance downtime or capacityproblems. Please try again later.
  33. 33. 503Service Temporarily UnavailableThe server is temporarily unable to service your request due tomaintenance downtime or capacityproblems. Please try again later.
  34. 34. From one instance…
  35. 35. …to thousands
  36. 36. Time: +00h <10 coresElastic Capacity
  37. 37. Time: +24h >1500 coresElastic Capacity
  38. 38. Time: +72h <10 coresElastic Capacity
  39. 39. Time: +120h >600 coresElastic Capacity
  40. 40. 40 servers to 5000 in 3 days EC2 scaled to peak of 5000 instances Number of EC2 Instances “Techcrunched” Launch of Facebook modification Steady state of ~40 instances 4/12/2008 4/13/2008 4/14/2008 4/15/2008 4/16/2008 4/17/2008 4/18/2008 4/19/2008 4/20/2008
  41. 41. The Toolbox
  42. 42. Reference Model Deployment & Administration App Services Compute Storage Database Networking AWS Global Infrastructure
  43. 43. Global infrastructure Deployment & Administration App ServicesCompute Storage Database Regions An independent collection of AWS resources in a Networking defined geography A solid foundation for meeting location-dependent AWS Global Infrastructure privacy and compliance requirements
  44. 44. Global infrastructure Deployment & Administration App ServicesCompute Storage Database Availability Zones Designed as independent failure zones Networking Physically separated within a typical metropolitan region AWS Global Infrastructure
  45. 45. Global infrastructure Deployment & Administration App ServicesCompute Storage Database Edge Locations To deliver content to end users with lower latency Networking A global network of edge locations Supports global DNS infrastructure (Route53) and AWS Global Infrastructure Cloud Front CDN
  46. 46. Networking Deployment & Administration App ServicesCompute Storage Database Direct Connect Dedicated connection between your IT Networking infrastructure and the AWS datacenters Extend your network infrastructure and VLANs AWS Global Infrastructure into AWS
  47. 47. Networking Internet Deployment & Administration App ServicesCompute Storage Database VPN Connection A Hardware VPN connection connects amazon Networking environment to your datacenter Internet Protocol security (IPsec) VPN connection AWS Global Infrastructure Commonly used hardware supported
  48. 48. Networking Internet Deployment & Administration App ServicesCompute Storage Database Virtual Private Cloud Private, isolated section of the AWS Cloud Networking Launch resources in a virtual network that you define complete control over your virtual networking AWS Global Infrastructure environment
  49. 49. Networking Route 53 Highly available and scalable Domain Name System Extremely reliable and cost effective Feature Details Global Supported from AWS global edge locations for fast and reliable domain name resolution Scalable Automatically scales based upon query volumes Latency based routing Supports resolution of endpoints based upon latency, Deployment & Administration enabling multi-region application delivery Integrated Integrates with other AWS services allowing Route 53 to front load balancers, S3 and EC2 App Services Secure Integrates with IAM giving fine grained control over DNS record accessCompute Storage Database Networking AWS Global Infrastructure
  50. 50. Compute Vertical Elastic Compute Cloud (EC2) Scaling Basic unit of compute capacity From $0.02/hr Range of CPU, memory & local disk options 13 Instance types available, from micro to cluster compute Feature Details Flexible Run windows or linux distributions Deployment & Administration Scalable Wide range of instance types from micro to cluster compute App Services Machine Images Configurations can be saved as machine images (AMIs) from which new instances can be created Full control Full root or administrator rightsCompute Storage Database Secure Full firewall control via Security Groups Monitoring Publishes metrics to Cloud Watch Networking Inexpensive On-demand, Reserved and Spot instance types AWS Global Infrastructure VM Import/Export Import and export VM images to transfer configurations in and out of EC2
  51. 51. Compute Trigger auto- scaling policyas-create-auto-scaling-group MyGroup --launch-configuration MyConfig --availability-zones eu-west-1a --min-size 4 --max-size 200 Deployment & Administration Auto-scaling Automatic re-sizing of compute clusters based upon App Services demandCompute Storage Database Feature Details Control Define minimum and maximum instance pool sizes and when scaling and cool down occurs Networking Integrated to Use metrics gathered by CloudWatch to drive scaling CloudWatch Instance types Run auto scaling for on-demand instances and spot. Compatible with VPC AWS Global Infrastructure
  52. 52. ComputeElastic Load BalancingCreate highly scalable applicationsDistribute load across EC2 instances in multipleavailability zones Deployment & Administration Feature Details Auto-scaling Automatically scales to handle request volume App Services Available Load balance across instances in multiple availability zonesCompute Storage Database Health checks Automatically checks health of instances and takes them in or out of service Session stickiness Route requests to the same instance Networking Secure sockets layer Supports SSL offload from web and application servers with flexible cipher support Monitoring Publishes metrics to Cloud Watch AWS Global Infrastructure
  53. 53. Storage S3 - Durable storage, any object 99.999999999% durability of objects Unlimited storage of objects of any type Feature Details Up to 5TB size per object Flexible object store Buckets act like drives, folder structures within Access control Granular control over object permissions Deployment & Administration Server-side encryption 256bit AES encryption of objects Multi-part uploads Improved throughput & control App Services Object versioning Archive old objects and version new ones Object expiry Automatically remove old objectsCompute Storage Database Access logging Full audit log of bucket/object actions Networking Web content hosting Serve content as web site with built in page handling Notifications Receive notifications on key events AWS Global Infrastructure Import/Export Physical device import/export service
  54. 54. Storage Elastic Block Store High performance block storage device 1GB to 1TB in size Mount as drives to instances Feature Details High performance file Mount EBS as drives and format as required system Deployment & Administration Flexible size Volumes from 1GB to 1TB in size Secure Private to your instances App Services Available Replicated within an Availability ZoneCompute Storage Database Backups Volumes can be snapshotted for point in time restore Monitoring Detailed metrics captured via Cloud Watch Networking AWS Global Infrastructure
  55. 55. Database Relational Database Service Database-as-a-Service No need to install or manage database instances Scalable and fault tolerant configurations Deployment & Administration Feature Details Platform support Create MySQL, SQL Server and Oracle RDBMS App Services Preconfigured Get started instantly with sensible default settings Automated patching Keep your database platform up to date automaticallyCompute Storage Database Backups Automatic backups and point in time recovery and full DB backups Backups Volumes can be snapshotted for point in time restore Networking Failover Automated failover to slave hosts in event of a failure AWS Global Infrastructure Replication Easily create read-replicas of your data and seamlessly replicate data across availability zones
  56. 56. Database DynamoDB Provisioned throughput NoSQL database Fast, predictable performance Fully distributed, fault tolerant architecture Feature Details Deployment & Administration Provisioned throughput Dial up or down provisioned read/write capacity Predictable Average single digit millisecond latencies from SSD performance backed infrastructure App Services Strong consistency Be sure you are reading the most up to date values Fault tolerant Data replicated across availability zonesCompute Storage Database Monitoring Integrated to Cloud Watch Networking Secure Integrates with AWS Identity and Access Management (IAM) Elastic MapReduce Integrates with Elastic MapReduce for complex analytics on large datasets AWS Global Infrastructure
  57. 57. Application ServicesAmazon SQS Processing resultsReliable, highly scalable, queueservice for storing messages as they Amazon SQStravel between instances Deployment & Administration Processing task/processing trig App Services Feature DetailsCompute Storage Database Reliable Messages stored redundantly across multiple availability zones Simple Simple APIs to send and receive messages Networking Scalable Unlimited number of messages Secure Authentication of queues to ensure controlled access AWS Global Infrastructure
  58. 58. Application ServicesSimple Workflow 1Reliably coordinate processing stepsacross applications Task A 2Integrate AWS and non-AWS resourcesManage distributed state in complexsystems Task B 3 (Auto-scaling) Deployment & Administration Task C App Services Feature Details Process state Maintain application state across complex workflows in a reliable and available mannerCompute Storage Database Tracking Tracks executions and log process for audit purposes Consistency Ensures processing tasks are executed and duplicity of Networking events does not occur Simple Simple Decider and Task programming model for rapid integration AWS Global Infrastructure
  59. 59. Application Services DocumentCloud Search ServerElastic search engine based uponAmazon A9 search engineFully managed service withsophisticated feature set SearchScales automatically Server Deployment & Administration Results App Services Feature Details Auto-scaling Automatically scales based upon request volumes and data volumesCompute Storage Database High performance In memory operation means consistently low latency for search results Networking Sophisticated features Support for faceting, stemming, synonyms, stop words and custom rank expressions Low cost Elastic service, pay for what you use AWS Global Infrastructure
  60. 60. Application ServicesCloudFront 3 Served from S3 /images/*World-wide content distributionnetworkEasily distribute content to end userswith low latency, high data transferspeeds, and no commitments. London 2 Served from EC2 *.php Paris Deployment & Administration 1 Single CNAME NY App Services Feature DetailsCompute Storage Database Fast Multiple world-wide edge locations to serve content as close to your users as possible Integrated with other Works seamlessly with S3 and EC2 origin servers services Networking Dynamic content Supports static and dynamic content from origin servers Streaming Supports rtmp from S3 and includes support for live AWS Global Infrastructure streaming from Adobe FMS and Microsoft Media Server
  61. 61. Deployment & Admin Elastic Beanstalk One-click deployment from Eclipse, Visual Studio and Git Rapid deployment of applications All AWS resources automatically created Deployment & Administration Feature Details Platform support Containers for Java, .net and PHP App Services Resource creation Creates load balancer, instances, autoscaling and monitoring automaticallyCompute Storage Database Monitoring & Logs Integrated with Cloud Watch and consolidates server logs Versioning Manage versions of applications and easily rollback deployments Networking Notifications Receive alerts on key events Full resource access Access all underlying AWS resources as necessary AWS Global Infrastructure
  62. 62. Deployment & Admin Cloud Formation Automate creation of ‘stacks’ in a repeatable way Scripting framework for AWS resource creation Deployment & Administration Feature Details Platform support Support for AWS resources from EC2 to IAM App Services Resource creation Creates AWS resources behind the scenes and reports on progressCompute Storage Database Declarative Specify stacks in JSON format and source control your environments Customizable Drive stack creation with paramaters Networking AWS Global Infrastructure
  63. 63. Deployment & Admin Identity & Access Management Granular control of user rights with AWS Automated granting of EC2 service rights Software Developer Kits Comprehensive support of programming models for Deployment & Administration using AWS services App ServicesCompute Storage Database Networking AWS Global Infrastructure
  64. 64. + others Simple Email ServiceSimple Notification Service ElastiCache Elastic MapReduce CloudWatch …
  65. 65. Introducing Amazon Redshift Data Warehousing the AWS Way Easily and rapidly analyze Automated deployment & petabytes of data administration1/10 the cost of traditional data Compatible with popular BI tools warehouses
  66. 66. Your Analytics AWS Data PipelineOrchestration service for data-driven workflowsCreate automated and scheduled data flowsPre-integrated with AWS data sourcesEasily connect with 3rd party & on-premises sources
  67. 67. NEW! Amazon Elastic Transcoder
  68. 68. Security &Compliance
  69. 69. Shared responsibility Foundation ServicesAmazon Compute Storage Database Networking Availability Zones AWS Global Edge Locations Infrastructure Regions
  70. 70. Shared responsibility Customer Data Platform, Applications, Identity & Access ManagementYou Operating System, Network & Firewall Configuration Client-side Data Encryption & Data Server-side Encryption Network Traffic Protection Integrity Authentication (File System and/or Data) (Encryption/Integrity/Identity) Foundation ServicesAmazon Compute Storage Database Networking Availability Zones AWS Global Edge Locations Infrastructure Regions
  71. 71. Security standards Certifications Physical Security HW, SW, NetworkSOC 1 Type 2 (formerly Datacenters in Systematic change SAS-70) nondescript facilities management ISO 27001 Physical access strictly Phased updates controlled deployment PCI DSS for EC2, S3, EBS, VPC, RDS, ELB, Must pass two-factor Safe storage IAM authentication at least decommission twice for floor access FISMA Moderate Automated monitoring Compliant Controls Physical access logged and self-audit and audited HIPAA & ITAR Advanced networkCompliant Architecture protection
  72. 72. So what arewe going to do today?
  73. 73. InstanceAvailability Zone Region
  74. 74. Instance S3Availability Zone Region
  75. 75. Cloud FrontInstance S3Availability Zone Region
  76. 76. Cloud FrontInstance S3 RDSAvailability Zone Region
  77. 77. Elastic Load Cloud Balancer Front Instance Instance S3 RDS Availability Zone Region
  78. 78. Elastic Load Cloud Balancer Front Instance Instance S3 Auto scaling Group RDS Availability Zone Region
  79. 79. Go grab some lunch, comeback and we’ll crack on
  80. 80. Elastic Load Cloud Balancer Front Instance Instance S3 Auto scaling Group RDS Availability Zone Region
  81. 81. EC2launch an instance
  82. 82. bootstrapping passing data to an instance
  83. 83. Instance User request data
  84. 84. Instance User Meta-data request data service
  85. 85. Instance User Meta-data request data service Instance
  86. 86. Shell script in user-data will be executed on launch:#!/bin/shyum -y install httpd php mysql php-mysqlchkconfig httpd on/etc/init.d/httpd start
  87. 87. key pairs secure access
  88. 88. Public Key Inserted by Amazon into each EC2 instance that you launch EC2 InstanceComms securedwith private key Private Key Downloaded and stored by you
  89. 89. security groups instance firewalling
  90. 90. Name Description Security Group Protocol Port 22 (SSH) Port rangePort 80 IP Address, range,(HTTP) or another security group instance
  91. 91. ELBelastic load balancer
  92. 92. Elastic Load BalancerInstance Instance Instance Instance Instance InstanceAvailability Zone Availability Zone Availability Zone Region
  93. 93. auto-scaling elastic server pool
  94. 94. Launch Configuration Auto-Scaling Group Auto-Scaling Policy Describes what Auto Auto Scaling managed Parameters forScaling will create when grouping of EC2 performing an Auto adding instances Scaling action Instances Automatic health check to Scale Up/Down and by AMI how much Instance Type maintain pool size Security Group ChangeInCapacity (+/- #) Instance Key Pair Automatically scale the number of instances by ExactCapacity (#) policy – Min, Max, Desired ChangeInPercent (+/- %) Only one active launch configuration at a time Cool Down (seconds) Automatic Integration withAuto Scaling will terminate ELB Policy can be triggered by instances with old launch CloudWatch events configuration first Automatic distribution & rolling update balancing across AZs
  95. 95. Create a launch configuration:as-create-launch-config --image-id ami-50348c51 --instance-type t1.micro --key apac-tok --group Web Servers’ --launch-config 101-launch-config
  96. 96. Create an auto-scaling group:as-create-auto-scaling-group 101-as-group --availability-zones ap-northeast-1a --launch-configuration 101-launch-config --load-balancers myELB --max-size 5 --min-size 1
  97. 97. Create an auto-scaling policy (scale up):as-put-scaling-policy 101ScaleUpPolicy --auto-scaling-group 101-as-group --adjustment=1 --type ChangeInCapacity --cooldown 300
  98. 98. Create an auto-scaling policy (scale down):as-put-scaling-policy 101ScaleDownPolicy --auto-scaling-group 101-as-group "--adjustment=-1" --type ChangeInCapacity --cooldown 300
  99. 99.