Introduction to Elastic MapReduce
•
10 recomendaciones•1,814 vistas
An introduction to Elastic MapReduce, including a demonstration of how to create a pre-configured, scalable Hadoop cluster in minutes.
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Destacado
Destacado (9)
Similar a Introduction to Elastic MapReduce
Similar a Introduction to Elastic MapReduce (20)
Más de Amazon Web Services
Más de Amazon Web Services (20)
Último
Último (20)
Introduction to Elastic MapReduce
- 1. Elastic Map Reduce Matt Wood T E C H N O L O G Y E VA N G E L I S T
- 2. Hello.
- 3. Thank you.
- 4. 3
- 6. Infrastructure services
- 9. ?
- 10. On demand
- 11. Pay as you go
- 12. Pay for what you use
- 13. Elastic capacity
- 14. Capacity Estimated demand Time
- 15. Capacity Infrastructure Investment Estimated demand Time
- 16. Capacity Infrastructure Real demand Time
- 17. Capacity Elastic capacity Real demand Time
- 19. Focus on your stuff
- 20. Idea Product
- 21. Idea Product Heavy lifting
- 22. Idea Product VERY Heavy lifting
- 23. Idea Product
- 24. Scalable storage Scalable compute Scalable tools
- 26. S3 Scalable storage Scalable compute Scalable tools EC2
- 27. Elastic Map Reduce
- 28. Hosted Hadoop
- 30. S3 Input data
- 31. S3 Input data Code Elastic MapReduce
- 32. S3 Input data Code Elastic Name MapReduce node
- 33. S3 Input data Code Elastic Name MapReduce node Elastic cluster
- 34. S3 Input data Code Elastic Name MapReduce node HDFS Elastic cluster
- 35. S3 Input data Code Elastic Name MapReduce node Queries HDFS + BI Via JDBC, Pig, Hive Elastic cluster
- 36. S3 Input data Code Elastic Name Output MapReduce node S3 + SimpleDB Queries HDFS + BI Via JDBC, Pig, Hive Elastic cluster
- 37. S3 Input data Elastic Output MapReduce S3 + SimpleDB
- 52. It’s all just Hadoop
- 53. HDFS + S3
- 55. API driven
- 56. Data movement
- 57. Import/Export
- 58. Multipart upload
- 59. Multipart, parallel results delivery
- 60. Scale control
- 61. Resize running job flows
- 62. 14 hours Time remaining: 14 hours
- 63. 14 hours Time remaining: 7 hours
- 64. Time remaining: 3 hours
- 65. Balance cost and performance
- 66. Resize based on usage patterns
- 67. Steady state Steady state Batch processing
- 68. Cluster types
- 69. Small
- 70. High memory High CPU or both
- 71. HPC
- 72. Nehalem Quad core HPC 10 gig E GPU
- 73. Access control
- 74. Private
- 75. Location
- 76. Identity and Access
- 77. 3 EMR By Example
- 78. Bioinformatics Web indexing Financial modelling File processing Data mining and BI Data warehousing Fraud detection Targeted advertising
- 79. Click stream analysis for Best Buy 3.5 billion records 71 million unique cookies 1.7 million targeted ads 13 Tb of clickstream logs Each day
- 80. Click stream analysis for Best Buy Workflow time from 2 days to 8 hours Procurement time from 2 months to 5 minutes $13k per month 500% increase return on advertising spend
- 81. Web log analysis and recommendation engine $29.9 million in sales 842 million page views 434 Gb of page logs 97 million ‘favourites’
- 86. Managed Hadoop
- 88. Data movement
- 89. Scale control
- 90. HPC instances
- 91. aws.amazon.com
- 92. Thank you!
- 93. Q U E S T I O N S + C O M M E N T S matthew@amazon.com @mza O N T W I T T E R