Amazon Web Services provides a number of database management alternatives for all type of customers. You can run managed relational databases, managed NoSQL databases, a petabyte-scale data warehouse, or you can even operate your own online database in the cloud on Amazon EC2. Discover our database offerings and find what service to use according to your existing needs or how to deliver your next big project. Find out about data migration services, tools and best practices for security, availability and scalability, and hear some of the great database success stories from AWS customers. Speaker: Ari Newman, Account Manager & Rob Carr, Solutions Architect, Amazon Web Services Featured Customer - Atlassian

1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Ari Newman, Account Manager & Rob Carr, Solution Architect
Amazon Web Services
George Barnett, Saas Platform Architect
Atlassian
Databases on AWS
Technical 101

2. Agenda
• Old World versus Managed
• Amazon RDS
• Amazon Redshift
• Amazon DynamoDB
• Demo
• Customer Success Story

3. Old World Databases
Very expensive Proprietary Lock in Punitive licensing
with limited flexibility
It’s Why Customers Have Been Moving To More Open, Customer Friendly, Less
Expensive Database Engines

4. On-­Premises Hosted Managed
“There's a lot of undifferentiated heavy lifting
that stands between your idea and success…
We call this muck”
– Jeff Bezos 2006
Why Managed Databases?

5. Amazon RDS

6. Amazon RDS
• Fully managed database service
• Choice of database engines
• Simple to deploy and scale
• Reliable and cost effective
Operational overhead Decreased
Agility Increased

7. Amazon RDS: Simple and Fast to Scale
Database instance types
offer a range of CPU and
memory selections
Database storage is
scalable on demand

8. Amazon RDS: Easy to Monitor

9. Amazon RDS security & Compliance

10. Amazon RDS: Multi-­AZ
Application
Servers
Web
Servers
Load
Balancer

11. Amazon RDS: Focus Your Team
Schema design
Query construction
Query optimization
Focus your
team here
Migration
Backup and recovery
Patching
Configuration
Software upgrades
Storage upgrades
Server upgrades
Hardware issues
On-­Demand
Let AWS
focus here

12. AWS Database Migration Service

13. Airbnb relies on Amazon RDS
”
“ Airbnb chose Amazon RDS because it simplifies much of the time-­
consuming administrative tasks typically associated with databases.
Amazon RDS allows difficult procedures, such as replication and scaling,
to be completed with a basic API call or through the AWS Management
Console.

14. Amazon Redshift

15. MPP SQL Database
Optimised for Analytics
Gigabytes to Petabytes
Fully Relational
Fully Managed
Amazon
Redshift

16. JDBC/ODBC
DB Visualizer
Agility Workbench
Redshift

17. Selected Amazon Redshift Customers

18. 0
50,000
100,000
150,000
200,000
250,000
300,000
350,000
400,000
Exadata SAP
HANA
Redshift
$400,000
$300,000
$55,000
7,200
2,700
15 15
Query
Performance
Data Load
Performance
1 year of data
1 million records
Latency in seconds
RedshiftExisting System
7X cheaper 180X faster
Boingo Migrated to Redshift

19. AWS Dynamo DB

20. Amazon DynamoDB: Managed NoSQL in the Cloud
• Fast, Consistent Performance
• Highly Scalable
• Flexible
• Fine-­grained Access Control
• Fully Managed

21. Amazon DynamoDB: Fast, Consistent Performance
Data stored on Solid State Drives (SSDs)
Automatic partitioning means no need
for hotspot management
Single-­digit millisecond latency
• At any scale

22. A Simple Architecture Using DynamoDB
Elastic Load
Balancing
Amazon
EC2 App
Instances
Auth &
business logic
Clients
DynamoDB

23. Adroll Uses AWS to Grow by More Than 15,000% in a Year
AdRoll, an online advertising platform, serves 50
billion impressions a day worldwide with its
global retargeting platforms.
We spend more on snacks
than we do on Amazon
DynamoDB.
• Needed high-­performance, flexible
platform to swiftly sync data for
worldwide audience
• Processes 50 TB of data a day
• Serves 50 billion impressions a day
• Stores 1.5 PB of data
• Worldwide deployment minimizes
latency
Valentino Volonghi
CTO, Adroll
”
“

24. Demo

25. G E O R G E B A R N E T T • S A A S P L A T F O R M
A R C H I T E C T • A T L A S S I A N
RDS @ Atlassian

26. About Me
• I’ve been building infrastructure for companies since
the late 90’s
• Atlassian for 7 years
• Last 5 years building the platform underlying
Atlassian Cloud

27. • We make collaboration tools for teams
• 5M users across 450k Organisations
• LOTS of JVMs and LOTS of databases.
About Atlassian

28. Databases are Hard

29. User clicks something? Database calls!
“I’ll just click here and create
some more load on the DBs”

30. Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Existing Architecture
• PostgreSQL
instance per
customer
• Database per
application
• Each customer is
pinned to a region
• Storage
subsystem takes
care of replication
of data
Per instance apps in each region with replicated storage
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL

31. Challenges?
Upgrades:
Replicating this much data is
complex and full of pain
Backups:
Large number of database
instances to backup = lots of custom
code
Replication:
High overhead to manage tens of
thousands of PostgreSQL instances

32. Atlassian is not a
database company.

33. The Atlassian mission is to unleash
the potential in every team.
Herding databases distracts our
engineers from this core mission.
“
”

34. Monarch
Project

35. Project Monarch
• Transfer
databases to AWS
• Using a low latency
AWS Direct Connect
• Into RDS
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL
Web Server
Confluence
JIRA
Bamboo
Crowd
PostgreSQL

36. • Push out the “Undifferentiated Heavy Lifting” to the AWS
RDS Team
• Refocus our team on things that matter to us
» Ensure data storage meets our requirements
» Manage customer data lifecycle
» Keep the data near to our customers
Project Monarch

37. Monarch
API Server
Administrators
DynamoDB
Simple Workflow
Service (SWF)
Create, Destroy & Rebalance
RDS Instances
Monarch
Worker
Simple Storage
Service (S3)
Store configuration
and metadata
Manage Workflow
State
Run workflows
(provision, dump,
snapshot, etc)
Create/Destroy
Databases
Relational
Database
Service (RDS)
Provisioning Systems
Applications

38. RDS enables database
instances on demand.

39. rds_client.create_db_instance(
DBInstanceIdentifier=name,
AllocatedStorage=100,
DBInstanceClass=instance_class,
→ Engine='postgres',
MasterUsername=db.PostgresInstanceControl.DEFAULT_MASTERUSER,
MasterUserPassword=password,
DBSubnetGroupName=db_subnet_name,
PreferredMaintenanceWindow='Sun:01:00-Sun:01:30',
→ BackupRetentionPeriod=14,
→ PreferredBackupWindow='01:30-02:00',
Port=db.PostgresInstanceControl.DEFAULT_PORT,
→ MultiAZ=multi_az,
→ EngineVersion='9.4.4',
→ AutoMinorVersionUpgrade=True,
Tags=tags_amz,
StorageType=storage_type,
StorageEncrypted=True,
CopyTagsToSnapshot=False
)
How easy? This easy:

40. Solved.
Upgrades:
RDS provides reliable, transparent
replication with the flick of a switch.
Backups:
Automated or manual. Or both.
Replication:
Managed upgrades takes the pain
off our team.

42. Try Amazon Databases for Free
Enough free instance-­hours to run a Micro
RDS instance continuously for 12 Months
Amazon RDS
Amazon DynamoDB
Amazon Redshift
25 GB of Storage
25 Units of Write Capacity
25 Units of Read Capacity
Two month free trial
750 DC1.Large hours for two months

43. Databases on AWS – Recap
• Amazon RDS – A Managed Database Service
• Amazon Redshift – PB Scale Managed Data Warehouse
• Amazon DynamoDB – Managed NoSQL in the Amazon
Cloud
• Try All 3 Service for Free

44. AWS Training & Certification
Intro Videos & Labs
Free videos and labs to
help you learn to work
with 30+ AWS services
– in minutes!
Training Classes
In-­person and online
courses to build
technical skills –
taught by accredited
AWS instructors
Online Labs
Practice working with
AWS services in live
environment –
Learn how related
services work
together
AWS Certification
Validate technical
skills and expertise –
identify qualified IT
talent or show you
are AWS cloud ready
Learn more: aws.amazon.com/training

45. Your Training Next Steps:
ü Visit the AWS Training & Certification pod to discuss your
training plan & AWS Summit training offer
ü Register & attend AWS instructor led training
ü Get Certified
AWS Certified? Visit the AWS Summit Certification Lounge to pick up your swag
Learn more: aws.amazon.com/training

46. Thank You