TECH WORKSHOP Johannes Borch – Solutions ArchitectAuthor: Carlos Conde – Solutions Architect
#1 AWS Technical Review#2 Cloud-Powered CI#4 Q&A Session
Core Principles
« Everything fails  all the time »Werner Vogels – CTO of Amazon
When you turn off your cloudresources, you actually stop     paying for them
Technical Review
Amazon EC2On-demand instances with admin access
Amazon Machine    Images Pre-configured server Image
YOUR CODE3rd PARTYLIBRARIES  CORESERVICESOPERATING SYSTEM AMI
YOUR CODE   YOUR CODE3rd PARTY   3rd PARTYLIBRARIES   LIBRARIES  CORE        CORESERVICES    SERVICESOPERATING   OPERATING...
YOUR CODE   YOUR CODE   YOUR CODE3rd PARTY   3rd PARTY   3rd PARTYLIBRARIES   LIBRARIES   LIBRARIES  CORE        CORE     ...
VM ImportEasily import virtual machine images from your existing         environment to Amazon EC2 instances • VMware ESX ...
Instance-Store     vs.  EBS-Store
32bits64bits
US East Region (N. VA)              EU West Region (IRE)                    Japan Region (Tokyo)Availability        Availa...
Amazon Route 53       On-demand DNS service                 +          Elastic IPDynamic IP addresses for EC2 instances
Horizontal Scaling
Amazon CloudWatch  Monitoring for AWS resources
Auto ScalingAutomatically scale up/down EC2 capacity
Elastic Load BalancingDistributes incoming traffic to EC2 instances
6 am
10 am
10 am
10 am
7 pm
7 pm
7 pm
without elasticity you cant accelerate
High Availability
Media Storage & Distribution
Amazon S3Simple Storage Service
1b   Tb
99.999999999%   durability
Amazon S3 GrowthTotal Number of Objects Stored in Amazon S3                                566                            ...
Tip: MFA Delete
Amazon CloudFront Flexible content delivery network
US West 1         US West 2       US East        Europe West   Asia Pacific   Asia Pacific(N. California)     (Oregon)    ...
DEMO
Data Storage
Data StorageRelational Databases
Amazon RDSRelational Database Service
Backups
[[ console screenshot ]]RDS automated backups
[[ console screenshot ]]RDS DB snapshots
Restore
[[ console screenshot ]]RDS DB snapshots
[[ console screenshot ]]RDS snapshot restore
RDS Read-Replicas For read-heavy applications
RDS Multi-AZSecondary replica in another Availability Zone
RDBMS on EC2  Special use cases
[[ console screenshot ]]restore EBS from snapshot
Amazon ElastiCacheMemcached compatible in-memory cache
Data Storage"NoSQL" Databases
Amazon SimpleDBNoSQL database, key-value model
DomainID       Category    Name        Color     Size    Make   Model Yearitem01   Clothes     Shirt       Siamese small, ...
ItemID       Category    Name        Color     Size    Make   Model Yearitem01   Clothes     Shirt       Siamese small,   ...
AttributesID       Category    Name        Color     Size    Make   Model Yearitem01   Clothes     Shirt       Siamese sma...
ValuesID       Category    Name        Color     Size    Make   Model Yearitem01   Clothes     Shirt       Siamese small, ...
Amazon DynamoDB Fully managed NoSQL database
Low Latency                          ADMIN Massive and Seamless      Scalability Durable and AvailablePredictable Performa...
Average reads<5ms, writes<10ms
DEMO
Best Practices
Design for Failure •   Elastic IP addresses •   Multiple Azs •   Snapshot EBS volumes
Multiple AWS accounts    •   Production    •   Development
AWS IAMIdentity and Access Management
145Identity & Access Management (IAM)IAM offers greater security, flexibility,and control when using AWS, including:• Inte...
Use multi-factorauthenticationfor admins
Loose Coupling Adopt SOA principles
Create Independent components  Design everything as a Black Box  Think in terms of services  Load-balance clustersAmazon S...
Amazon SQSSimple Queue Service
Use notificationsYou need to know when somethings wrong
Amazon CloudWatch  Monitoring for AWS resources               +    Amazon SNS   Simple Notification Service
Tip – Instance Optimizer             Free Memory               Free CPU       PUT                       2 weeks           ...
Implement Elasticity   … In all your components
AutomateAWS is a programmable datacenter
App Vending   MachinePre-configuredIT security-blessedauto-scalableauto-backupmulti-AZfull-controlone-click deployableente...
APIs / CLIScript your IT infrastructure
Java, Ruby, Python, PHP, .Net…res = ec2.runInstances new RunInstancesRequest([         imageId: "ami-00754474",         ke...
CLIPROMPT> ec2-run-instances ami-b232d0db -n 3 --availability-zone us-east-1a
HTTPhttps://ec2.amazonaws.com/?Action=RunInstances&ImageId=ami-60a54009&MaxCount=3&MinCount=1&Placement.AvailabilityZone=u...
AWS CloudFormation Template-based provisioning service
Test & PrototypeOn-demand, pay as you go testing and           prototyping
Data-based decision        makingDrive your development by users feedback
"Hadoop is a reliable storage and data analysis system"               HDFS                 MapReduce
MapReduce
(map    ‘(   ))          (    )(reduce   ‘(   ))
Each input to a map is a list of <key, value> pairs(<a, > , <o, > , <p, > , …)Each output of a map is a list of <key, valu...
Deploying a Hadoop cluster is hardhttp://eddie.niese.net/20090313/dont-pity-incompetence/
Amazon Elastic MapReduceHadoop + The AWS Cloud
Data Warehouse                                 (Batch Processing)Data Warehouse                                           ...
Reducing Costs with Spot Instances            Scenario #1                             Scenario #2                         ...
AWS is a set of infrastructure building blocks
Amazon Web Services is all about FLEXIBILITY
« Want to increase innovation?  Lower the cost of failure »                             Joi Ito
AWS lowers the cost of     innovation Testing a new idea is cheap
Resources
Architecture Centeraws.amazon.com/architecture
Articles & Tutorialsaws.amazon.com/articles
Videos & Webinarsaws.amazon.com/resources/webinars
FREE TIER!aws.amazon.com/free
Plat_forms web development contestUlrich Stärk, Freie Universität Berlin – Plat_forms web development contest:Der Wettbewe...
Q &A
THANK YOUaws.amazon.com
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Amazon Web Services, Technical Workshop, Berlin, January 2012
Próxima SlideShare
Cargando en…5
×

Amazon Web Services, Technical Workshop, Berlin, January 2012

1.582 visualizaciones

Publicado el

Publicado en: Tecnología, Empresariales
0 comentarios
0 recomendaciones
Estadísticas
Notas
  • Sé el primero en comentar

  • Sé el primero en recomendar esto

Sin descargas
Visualizaciones
Visualizaciones totales
1.582
En SlideShare
0
De insertados
0
Número de insertados
9
Acciones
Compartido
0
Descargas
27
Comentarios
0
Recomendaciones
0
Insertados 0
No insertados

No hay notas en la diapositiva.

Amazon Web Services, Technical Workshop, Berlin, January 2012

  1. 1. TECH WORKSHOP Johannes Borch – Solutions ArchitectAuthor: Carlos Conde – Solutions Architect
  2. 2. #1 AWS Technical Review#2 Cloud-Powered CI#4 Q&A Session
  3. 3. Core Principles
  4. 4. « Everything fails all the time »Werner Vogels – CTO of Amazon
  5. 5. When you turn off your cloudresources, you actually stop paying for them
  6. 6. Technical Review
  7. 7. Amazon EC2On-demand instances with admin access
  8. 8. Amazon Machine Images Pre-configured server Image
  9. 9. YOUR CODE3rd PARTYLIBRARIES CORESERVICESOPERATING SYSTEM AMI
  10. 10. YOUR CODE YOUR CODE3rd PARTY 3rd PARTYLIBRARIES LIBRARIES CORE CORESERVICES SERVICESOPERATING OPERATING SYSTEM SYSTEM AMI AMI
  11. 11. YOUR CODE YOUR CODE YOUR CODE3rd PARTY 3rd PARTY 3rd PARTYLIBRARIES LIBRARIES LIBRARIES CORE CORE CORESERVICES SERVICES SERVICESOPERATING OPERATING OPERATING SYSTEM SYSTEM SYSTEM AMI AMI AMI
  12. 12. VM ImportEasily import virtual machine images from your existing environment to Amazon EC2 instances • VMware ESX VMDK images • Citrix Xen VHD images • Microsoft Hyper-V VHD images for Microsoft Windows Server 2003 (R2) and 2008 (R1 & R2)
  13. 13. Instance-Store vs. EBS-Store
  14. 14. 32bits64bits
  15. 15. US East Region (N. VA) EU West Region (IRE) Japan Region (Tokyo)Availability Availability Availability Availability Zone A Zone B Zone A Zone B Availability Availability Zone A Zone BAvailability Availability Availability Zone C Zone D Zone C US West 1 Region (N. CA) APAC Region (Singapore) US West 2 Region (Oregon)Availability Availability Availability Availability Availability Availability Zone A Zone B Zone A Zone B Zone A Zone B
  16. 16. Amazon Route 53 On-demand DNS service + Elastic IPDynamic IP addresses for EC2 instances
  17. 17. Horizontal Scaling
  18. 18. Amazon CloudWatch Monitoring for AWS resources
  19. 19. Auto ScalingAutomatically scale up/down EC2 capacity
  20. 20. Elastic Load BalancingDistributes incoming traffic to EC2 instances
  21. 21. 6 am
  22. 22. 10 am
  23. 23. 10 am
  24. 24. 10 am
  25. 25. 7 pm
  26. 26. 7 pm
  27. 27. 7 pm
  28. 28. without elasticity you cant accelerate
  29. 29. High Availability
  30. 30. Media Storage & Distribution
  31. 31. Amazon S3Simple Storage Service
  32. 32. 1b Tb
  33. 33. 99.999999999% durability
  34. 34. Amazon S3 GrowthTotal Number of Objects Stored in Amazon S3 566 Billion 262 Billion 102 Billion 40 Billion 2.9 Billion 14 Billion
  35. 35. Tip: MFA Delete
  36. 36. Amazon CloudFront Flexible content delivery network
  37. 37. US West 1 US West 2 US East Europe West Asia Pacific Asia Pacific(N. California) (Oregon) (N. Virginia) (Dublin) (Singapore) (Tokyo) AWS Regions AWS Edge Locations (CloudFront & Route 53)
  38. 38. DEMO
  39. 39. Data Storage
  40. 40. Data StorageRelational Databases
  41. 41. Amazon RDSRelational Database Service
  42. 42. Backups
  43. 43. [[ console screenshot ]]RDS automated backups
  44. 44. [[ console screenshot ]]RDS DB snapshots
  45. 45. Restore
  46. 46. [[ console screenshot ]]RDS DB snapshots
  47. 47. [[ console screenshot ]]RDS snapshot restore
  48. 48. RDS Read-Replicas For read-heavy applications
  49. 49. RDS Multi-AZSecondary replica in another Availability Zone
  50. 50. RDBMS on EC2 Special use cases
  51. 51. [[ console screenshot ]]restore EBS from snapshot
  52. 52. Amazon ElastiCacheMemcached compatible in-memory cache
  53. 53. Data Storage"NoSQL" Databases
  54. 54. Amazon SimpleDBNoSQL database, key-value model
  55. 55. DomainID Category Name Color Size Make Model Yearitem01 Clothes Shirt Siamese small, medium, largeitem02 Clothes Sweater Blue, large 2006, Yellow, 2007 Pinkitem03 Car parts Emissions O2 Audi S4 2000, sensor 2001, 2002
  56. 56. ItemID Category Name Color Size Make Model Yearitem01 Clothes Shirt Siamese small, medium, largeitem02 Clothes Sweater Blue, large 2006, Yellow, 2007 Pinkitem03 Car parts Emissions O2 Audi S4 2000, sensor 2001, 2002
  57. 57. AttributesID Category Name Color Size Make Model Yearitem01 Clothes Shirt Siamese small, medium, largeitem02 Clothes Sweater Blue, large 2006, Yellow, 2007 Pinkitem03 Car parts Emissions O2 Audi S4 2000, sensor 2001, 2002
  58. 58. ValuesID Category Name Color Size Make Model Yearitem01 Clothes Shirt Siamese small, medium, largeitem02 Clothes Sweater Blue, large 2006, Yellow, 2007 Pinkitem03 Car parts Emissions O2 Audi S4 2000, sensor 2001, 2002
  59. 59. Amazon DynamoDB Fully managed NoSQL database
  60. 60. Low Latency ADMIN Massive and Seamless Scalability Durable and AvailablePredictable Performance Zero Administration
  61. 61. Average reads<5ms, writes<10ms
  62. 62. DEMO
  63. 63. Best Practices
  64. 64. Design for Failure • Elastic IP addresses • Multiple Azs • Snapshot EBS volumes
  65. 65. Multiple AWS accounts • Production • Development
  66. 66. AWS IAMIdentity and Access Management
  67. 67. 145Identity & Access Management (IAM)IAM offers greater security, flexibility,and control when using AWS, including:• Integration with your corporate directory• Create and manage user groups• Assign Permissions to Users and Groups• Manage Passwords
  68. 68. Use multi-factorauthenticationfor admins
  69. 69. Loose Coupling Adopt SOA principles
  70. 70. Create Independent components Design everything as a Black Box Think in terms of services Load-balance clustersAmazon SQS as Buffers Tight Coupling Controller A Controller B Controller C Q Q Q Loose Coupling using Queues Controller A Controller B Controller C
  71. 71. Amazon SQSSimple Queue Service
  72. 72. Use notificationsYou need to know when somethings wrong
  73. 73. Amazon CloudWatch Monitoring for AWS resources + Amazon SNS Simple Notification Service
  74. 74. Tip – Instance Optimizer Free Memory Free CPU PUT 2 weeks Free HDD At 1-min intervals Amazon CloudWatch Alarm Instance Custom Metrics “You could save a bunch of money by switching to a small instance, Click on CloudFormation Script to Save”
  75. 75. Implement Elasticity … In all your components
  76. 76. AutomateAWS is a programmable datacenter
  77. 77. App Vending MachinePre-configuredIT security-blessedauto-scalableauto-backupmulti-AZfull-controlone-click deployableenterprise apps
  78. 78. APIs / CLIScript your IT infrastructure
  79. 79. Java, Ruby, Python, PHP, .Net…res = ec2.runInstances new RunInstancesRequest([ imageId: "ami-00754474", keyName: "aws-sa-ww-key", instanceType: "m1.small", securityGroups: ["httpssh"], minCount: 1, maxCount: 1, userData: "AWSWeb.war".bytes.encodeBase64().toString() ])…
  80. 80. CLIPROMPT> ec2-run-instances ami-b232d0db -n 3 --availability-zone us-east-1a
  81. 81. HTTPhttps://ec2.amazonaws.com/?Action=RunInstances&ImageId=ami-60a54009&MaxCount=3&MinCount=1&Placement.AvailabilityZone=us-east-1b&Monitoring.Enabled=true&AUTHPARAMS
  82. 82. AWS CloudFormation Template-based provisioning service
  83. 83. Test & PrototypeOn-demand, pay as you go testing and prototyping
  84. 84. Data-based decision makingDrive your development by users feedback
  85. 85. "Hadoop is a reliable storage and data analysis system" HDFS MapReduce
  86. 86. MapReduce
  87. 87. (map ‘( )) ( )(reduce ‘( ))
  88. 88. Each input to a map is a list of <key, value> pairs(<a, > , <o, > , <p, > , …)Each output of a map is a list of <key, value> pairs(<a’, >, <o’, >, <p’, >, …)Each input to a reduce is a <key, value-list>(<a’, >, …)Reduced into a list of values
  89. 89. Deploying a Hadoop cluster is hardhttp://eddie.niese.net/20090313/dont-pity-incompetence/
  90. 90. Amazon Elastic MapReduceHadoop + The AWS Cloud
  91. 91. Data Warehouse (Batch Processing)Data Warehouse Data Warehouse (Steady State) (Steady State) Shrink to Expand to 9 instances 25 instances
  92. 92. Reducing Costs with Spot Instances Scenario #1 Scenario #2 Job Flow Job Flow Duration: Duration: 7 Hours 14 Hours Cost : #2: Cost with Spot 4 instances *14 hrs * $0.50 = $28 4 instances *7 hrs * $0.50 = $13 + 5 instances * 7 hrs * $0.25 = $8.75 Total = $21.75 Time Savings: 50% Cost Savings: ~22%
  93. 93. AWS is a set of infrastructure building blocks
  94. 94. Amazon Web Services is all about FLEXIBILITY
  95. 95. « Want to increase innovation? Lower the cost of failure » Joi Ito
  96. 96. AWS lowers the cost of innovation Testing a new idea is cheap
  97. 97. Resources
  98. 98. Architecture Centeraws.amazon.com/architecture
  99. 99. Articles & Tutorialsaws.amazon.com/articles
  100. 100. Videos & Webinarsaws.amazon.com/resources/webinars
  101. 101. FREE TIER!aws.amazon.com/free
  102. 102. Plat_forms web development contestUlrich Stärk, Freie Universität Berlin – Plat_forms web development contest:Der Wettbewerb wird am 03. und 04.04.2012 in den Räumen des Henry-Ford-Baus der Freien Universität Berlin stattfinden;der 02.04. wird als Anreise- und Aufbautag genutzt: https://www.plat-forms.org/Plat_Forms ist ein Experiment um die Eigenschaften verschiedenerWebentwicklungsplattformen (Java, .NET, PHP, Ruby, Perl, usw.)wissenschaftlich zu untersuchen, bei dem Teams professionellerSoftwareentwickler gegeneinander antreten
  103. 103. Q &A
  104. 104. THANK YOUaws.amazon.com

×