Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.

Using AWS Purpose-Built Databases to Modernize your Applications

506 visualizaciones

Publicado el

As you look to modernizing your applications, you will need to consider your database options to meet the new application requirements. AWS offers a series of purpose-built databases that include relational, key value, document, graph and cache use cases to help you deliver new and enhanced functionalities. In this webinar session, we share the different modern application architectures, and how to combine different database services to meet your requirements. Understand how to modernize your relational databases through easy upgrades with Amazon Relational Database Service and learn how to migrate from one database to another with AWS Database Migration Service and AWS Schema Conversion Tool.

Speaker:
Blair Layton, Business Development Manager, Amazon Web Services

  • Sé el primero en comentar

Using AWS Purpose-Built Databases to Modernize your Applications

  1. 1. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Using AWS Purpose-Built Databases to Modernize your Applications Blair Layton Business Development - Database Services
  2. 2. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda 1. The Database Market is Changing 2. Application Architecture is Changing 3. AWS Database Services Overview 4. Modernization Paths 5. Relational Database Modernization 6. RDS Database Upgrade Demo! 7. Migrating Databases to AWS (DMS and SCT) 8. What Data Store to use for Refactoring/Rearchitecting 9. Modernizing an Application Data Tier – Step by Step 10. Summary
  3. 3. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. The Database Market is Changing
  4. 4. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Traditional Database Architecture App/Web Tier Client Tier RDBMS one database for all workloads
  5. 5. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Traditional Database Architecture key-value access complex queries transactions analytics App/Web Tier Client Tier RDBMS
  6. 6. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Data Tier Cache Data Warehouse Blob Store RDBMSNoSQL Search Cloud Data Tier Architecture App/Web Tier Client Tier best database for each workload
  7. 7. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Data Tier Cache Data Warehouse Blob Store RDBMSNoSQL Search Workload Driven Data Store Selection logging rich search key/value simple query hot reads analytics complex queries & transactions
  8. 8. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Database Characteristics Referential integrity with strong consistency, transactions, and hardened scale GraphKey-value DocumentRelational Low-latency, key-based queries with high throughput and fast ingestion of data Indexing and storing documents with support for query on any property Creating and navigating relations between data easily and quickly {;} In-memory Search Microsecond latency, key- based queries, specialized data structures Indexing and searching semistructured logs and data Amazon Aurora, Amazon RDS Amazon DynamoDB Amazon DynamoDB Amazon Neptune Amazon ElastiCache for Redis & Memcached Amazon Elasticsearch Service
  9. 9. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Application Architecture is Changing
  10. 10. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Microservices at Amazon Service-Oriented Architecture (SOA) Single-purpose Connect only through APIs Connect over HTTPS “Microservices”
  11. 11. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Monolithic vs. SOA vs. Microservices SOA Coarse-grained Microservices Fine-grained Monolithic Single Unit
  12. 12. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Microservices… Eliminates any long-term commitment to a technology stack Polyglot ecosystem Polyglot persistence • Decompose Databases • Database per microservice pattern Allows easy use of Canary and Blue-Green deployments
  13. 13. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Database Services
  14. 14. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. DW | Big Data Processing | Ad hoc AWS Databases and Analytics Broadest and deepest portfolio purpose-built for builders Business Intelligence & Machine Learning Data Movement Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams Amazon QuickSight Relational Databases RDS Aurora Data lake (Batch/ETL) S3/Glacier (Storage) Glue (ETL & Data Catalog) Machine Learning Macie (Data Protection) Non-Relational Databases Analytics (OLAP/DSS) DynamoDB (Wide Column/Document) ElastiCache (Indexed Key Value) Amazon Redshift EMR Athena Kinesis Data Analytics Elasticsearch Service Real-time Operational (OLTP) Neptune (Graph)
  15. 15. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. DW | Big Data Processing | Ad hoc AWS Databases and Analytics Broadest and deepest portfolio purpose-built for builders Business Intelligence & Machine Learning Data Movement Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams Amazon QuickSight Relational Databases RDS Aurora Data lake (Batch/ETL) S3/Glacier (Storage) Glue (ETL & Data Catalog) Machine Learning Macie (Data Protection) Non-Relational Databases Analytics (OLAP/DSS) DynamoDB (Wide Column/Document) ElastiCache (Indexed Key Value) Amazon Redshift EMR Athena Kinesis Data Analytics Elasticsearch Service Real-time Operational (OLTP) Neptune (Graph)
  16. 16. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon RDS Managed relational database service with a choice of six popular database engines Easy to administer Highly flexible Available & durable Fast No need for infrastructure provisioning, installing and maintaining database software. Scale database compute and storage with a few mouse clicks and zero downtime. Multi-AZ: Automatically replicates data. Automated backup, snapshots, failover. Choose between dual SSD- backed storage for high- performance OLTP.
  17. 17. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Aurora MySQL and PostgreSQL-compatible relational database built for the cloud Performance and availability of commercial-grade databases at 1/10th the cost Performance & scalability 5x throughput of standard MySQL and 3x of standard PostgreSQL; scale-out up to 15 read replicas Highly secure Network isolation, encryption at rest and in transit Availability & durability Fault-tolerant, self-healing storage. Six copies of data across three AZs. Continuous backup to Amazon S3 Fully managed Managed by Amazon RDS: no hardware provisioning, software patching, setup, configuration, or backups
  18. 18. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon DynamoDB Fast and flexible NoSQL database service for any scale Key-value NoSQL database that supports both document and wide column structures Fast, consistent performance Highly scalable Fully managed Business-critical reliability Consistent single-digit millisecond latencies at any scale. DAX speeds up times to microseconds. Auto-scaling tables serving millions of requests per second, storing hundreds of terabytes of data. Automatic provisioning and infrastructure management. Data replicated across multiple AZs and accessed with regionally available APIs.
  19. 19. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. VPC Endpoints April 2017 Auto Scaling June 2017 DynamoDB Accelerator (DAX) April 2017 Time to Live (TTL) February 2017 Global Tables N E W ! Backup and Restore N E W ! Amazon DynamoDB Delivering on customer needs Encryption at rest N E W ! February 2018November 2017 November 2017
  20. 20. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Neptune Fully managed graph database Fast Reliable Open Query billions of relationships with millisecond latency Six replicas of your data across three AZs with full backup and restore Build powerful queries easily with Gremlin and SPARQL Supports Apache TinkerPop & W3C RDF graph models Easy
  21. 21. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Highly Connected Data Best Represented in a Graph Social news feed Restaurant recommendations Retail fraud detection
  22. 22. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ElastiCache Extreme performance Secure & hardened Easily scalable Highly available & reliable In-memory data store and cache for sub-millisecond response times VPC for cluster isolation, encryption at rest and transit, and HIPAA compliance Read scaling with replicas, write and memory scaling with sharding, undisruptive scaling Multi-AZ with automatic failover Fully managed, Redis or Memcached compatible, in-memory data store andcache
  23. 23. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Internet scale applications need low latency and high throughput In-memory data stores and caches: • Deliver sub-millisecond performance • Deliver high throughput to support millions of users • Significantly reduce cost-at-scale Gaming leaderboards Social media Ride hailing Session stores Media streaming Dating Why Use In-Memory Data Stores and Caches
  24. 24. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Modernization Paths
  25. 25. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. The 6Rs of Migration Planning Discover, Assess & PrioritizeApplications Use Migration Tools Transition Production Redesign Application/ InfrastructureArchitecture App Code Development PurchaseCOTS/ SaaS & licensing Validation Modify underlying Infrastructure Full ALM/ SDLC Manual Config Manual Deploy Manual Install Determine Migration Path Automate Manual Install & Setup Integration Determine new platform
  26. 26. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Relational Database Modernization
  27. 27. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Relational Database Modernization • Oracle 11gR2 requires additional extended support contract and additional fees from Jan 1, 2019 with support ending on Dec 31, 2020 • Microsoft SQL Server 2008 and 2008 R2 are in extended support with support ending on Jul 9, 2019 • MySQL 5.5 support ends on Dec 2018 • PostgreSQL 9.3 support ended in Sep 2018
  28. 28. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Relational Database Modernization - Options • Upgrade on-prem • Upgrade on-prem with Amazon RDS on VMware • Migrate to AWS on VMware and then upgrade • Migrate to EC2/RDS and then upgrade • Migrate directly to a later version in AWS • Migrate to another database, e.g. Oracle to MySQL • If on RDS – use the single click upgrade option
  29. 29. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. RDS Upgrade Demo!
  30. 30. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Migrating Databases to AWS
  31. 31. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Database Migration Service (AWS DMS) DMS migrates databases to AWS easily and securely with minimal downtime. It can migrate your data to and from most widely used commercial and open-source databases. Amazon Aurora DynamoDBS3 Bucket
  32. 32. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Schema Conversion Tool (AWS SCT) SCT helps automate many database schema and code conversion tasks when migrating between database engines or data warehouse engines Amazon Aurora
  33. 33. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Database Migration the Easier Way Step 1: Convert or copy your schema Source DB or DW AWS SCT Native tool Destination DB or DW Step 2: Move your data Source DB or DW AWS SCT Destination DB or DW AWS DMS
  34. 34. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. New NoSQL support Migrate to AWS • Move from MongoDB to Amazon DynamoDB • Move from MongoDB to relational DB’s • Move from Apache Cassandra to DynamoDB Move between NoSQL and SQL • Change technologies Amazon Aurora DynamoDB DynamoDB RDS
  35. 35. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Support for S3 as a Source and Target Extract Data from any supported DMS source to S3 and to any DMS target S3 Bucket Amazon Aurora S3 Bucket Amazon Aurora DynamoDB
  36. 36. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. SCT can tell you how hard the migration will be 1. Connect SCT to Source and Target databases. 2. Run Assessment Report. 3. Read Executive Summary. 4. Follow detailed instructions.
  37. 37. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. >90,000 Databases Migrated with DMS
  38. 38. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. What Data Store to use for Refactoring/Rearchitecting?
  39. 39. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Challenge: What Data Store to Use? • Many problems can be solved with NoSQL, RDBMS or even in- memory cache technologies • Non-functional requirements can help identify appropriate services • Solution: Classify your organizations non-functional requirements and map them to service capabilities
  40. 40. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Determine Your Non-Functional Requirements Requirement Latency > 1s 200 ms -1s 20 ms – 200 ms < 20 ms Durability 99.99 99.999 99.9999 > 99.9999 Storage Scale < 256 GB 256 GB – 1 TB 1 TB – 16 TB > 16 TB Availability 99 99.9 99.95 > 99.95 Data Class Public Important Secret Top Secret Recoverability 12 – 24 hours 1 – 12 hours 5 mins – 1 hour < 5 mins Skills None Average Good Expert This is only an example. Your company’s classifications will be different There will be other requirements such as regulatory compliance too.
  41. 41. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Map Non-Functional Requirements to Services Service Latency Durability Storage Availability Recoverability from AZ Failure (RPO, RTO) RDS < 100 ms > 99.8 (EBS) 16 TB 99.95 0s and 90s (MAZ) Aurora < 100 ms > 99.9 64 TB > 99.95 0s and < 30s (MAZ) Aurora + ElastiCache < 1 ms > 99.9 64 TB > 99.95 0s and < 30s (MAZ) DynamoDB < 10 ms > 99.9 No Limit > 99.99 0s and 0s DynamoDB / DAX < 1 ms > 99.9 No Limit > 99.99 0s and 0s ElastiCache Redis < 1 ms N/A 6.1 TiB 99.95 0s and < 30s (MAZ) Elasticsearch < 200 ms > 99.9 1.5 PB 99.95 0s and < 30s (Zone Aware) S3 < 500 ms 99.999999999 No Limit 99.99 0s and 0s The information below is not exact and does not represent SLAs
  42. 42. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Finalizing Your Data Store Choices • After mapping your non-functional requirements to services you should have a short list to choose from • Functional requirements such as geospatial data and query support will refine the list further • You may institute standards to make data store selection simpler and also make it easier for people to move between teams, e.g Redis over Memcached and PostgreSQL over MySQL. These can still be overridden, but require justification to senior management
  43. 43. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Modernizing an Application Data Tier – Step by Step
  44. 44. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Route 53 CloudFront Availability Zone #1 Amazon S3 Availability Zone #2 Amazon EC2Amazon EC2 Auto Scaling Geo Routing US East User Amazon CloudWatch RDS DB Instance Active (Multi-AZ) RDS DB Instance Standby (Multi-AZ)
  45. 45. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Route 53 CloudFront Availability Zone #1 Amazon S3 Availability Zone #2 Amazon EC2Amazon EC2 Auto Scaling Geo Routing US East User Amazon CloudWatch RDS DB Instance Active (Multi-AZ) RDS DB Instance Standby (Multi-AZ) RDS DB instance read replica
  46. 46. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Route 53 CloudFront Availability Zone #1 Amazon S3 DynamoDB Availability Zone #2 Amazon EC2Amazon EC2 Auto Scaling Geo Routing US East User Amazon CloudWatch RDS DB Instance Active (Multi-AZ) RDS DB Instance Standby (Multi-AZ) RDS DB instance read replica
  47. 47. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Route 53 CloudFront Availability Zone #1 Amazon S3 DynamoDB Availability Zone #2 Amazon EC2 ElastiCache Memcached Amazon EC2 Auto Scaling Geo Routing US East User Amazon CloudWatch RDS DB Instance Active (Multi-AZ) RDS DB Instance Standby (Multi-AZ) RDS DB instance read replica
  48. 48. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Route 53 CloudFront Availability Zone #1 Amazon S3 DynamoDB Availability Zone #2 Amazon EC2 ElastiCache (Redis Master) ElastiCache Memcached Amazon EC2 Redis Slave Auto Scaling Geo Routing US East User Amazon CloudWatch Aurora DB Instance Active (Multi-AZ) Aurora DB instance read replica Amazon Redshift
  49. 49. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Taking it Further… • Microservices • Containers with Amazon Elastic Container Service, Amazon Elastic Container Service for Kubernetes, AWS Fargate • Serverless with AWS Lambda, AWS Batch, AWS Step Functions, Amazon Aurora MySQL Serverless • Integrate new functionality for IoT, AI/ML, Mobile, AR/VR, and media – all through managed AWS services
  50. 50. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Summary
  51. 51. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Summary • The database market is changing • Application architecture is changing • Relational databases are not the best solutions for all workloads • Choose the best database or data store for the job at hand • AWS has a comprehensive data management platform that enables you to modernize your applications
  52. 52. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. DW | Big Data Processing | Ad hoc AWS Databases and Analytics Broadest and deepest portfolio purpose-built for builders Business Intelligence & Machine Learning Data Movement Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams Amazon QuickSight Relational Databases RDS Aurora Data lake (Batch/ETL) S3/Glacier (Storage) Glue (ETL & Data Catalog) Machine Learning Macie (Data Protection) Non-Relational Databases Analytics (OLAP/DSS) DynamoDB (Wide Column/Document) ElastiCache (Indexed Key Value) Amazon Redshift EMR Athena Kinesis Data Analytics Elasticsearch Service Real-time Operational (OLTP) Neptune (Graph)
  53. 53. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Digital Training Start your journey to the AWS Cloud and make informed decisions about modernisation on AWS: • AWS Application Services Overview » • AWS Database Services Overview » • AWS Development Tools Services Overview » • AWS Analytics Services Overview » • Introduction to AWS Application Discovery Service » • Migrating and Tiering Storage on AWS » • VMware Cloud on AWS (Technical) » Access a library of free courses online, with AWS Digital Training. Get started today at aws.training »
  54. 54. © 2018 Amazon Web Services, Inc. or its Affiliates. All rights reserved. We hope you found it interesting! A kind reminder to complete the survey. Let us know what you thought of today’s event and how we can improve the event experience for you in the future. Thank You For Attending AWS Modernize Your Applications and Infrastructure Webinar Series. aws-apac-marketing@amazon.com twitter.com/AWSCloud facebook.com/AmazonWebServices youtube.com/user/AmazonWebServices slideshare.net/AmazonWebServices twitch.tv/aws

×