Learn about architecting a highly available RDS MySQL implementation to support your high-performance applications and production workloads. We will also talk about best practices in the areas of security, storage, compute configurations, and management that will contribute to your success with Amazon RDS for MySQL. In addition, you will learn about how to effectively move data between Amazon RDS and on-premises instances.

1. November 14, 2014 | Las Vegas, NV
Pavan Pothukuchi, Principal Product Manager, RDS
Sajee Mathew, Solutions Architect, AWS

5. DB Master
App
Backup
AWS Region
Replication
App
scp
Load data
Staging server
DB Slave

8. SQL
Flat files

9. mysql> GRANT SELECT,REPLICATION USER,REPLICATION CLIENT ON *.* TO repluser@‘<RDS Endpoint>' IDENTIFIED BY ‘<password>';
Create replication user on the master
Record the “File” and the “Position” in the backup
$ mysqldump --databases sampledb--master-data=2 --single-transaction -r sampledbdump.sql-u mysqluser–p mysqluserpassword
-- --Position to start replication or point-in-time recovery from-- --CHANGE MASTER TO MASTER_LOG_FILE='mysql-bin-changelog.000031', MASTER_LOG_POS=107;

10. Configure replication target
mysql> call mysql.rds_set_external_master(‘<master server>',3306,‘<replicationuser>',‘<password>','mysql-bin-changelog.000031',107,0);
mysql> call mysql.rds_start_replication;
Configure the replication target and start replication
Stop the app pointing at the source. Stop replication after target catches up
mysql> call mysql.rds_stop_replication;
Promote target Amazon RDS database instance
mysql> call mysql.rds_reset_external_master;
Point the app at the target Amazon RDS database instance

11. AWS Region
App
Dump Data
Staging server
scp& load
Master
Slave
mysql> call mysql.rds_set_configuration('binlogretention hours', 48);

14. Physical
synchronous
replication
AZ1
AZ2
DNS
cnameupdate

15. Sync
replication
Asyncreplication

16. [ERROR] Slave I/O: Got fatal error 1236 from master when reading data from binary log: ‘Client requested master to start replication from impossible position;

17. Source: https://blogs.oracle.com/MySQL/entry/mysql_5_6_replication_performance

18. AZ1
AZ2
AZ1

20. Reads10%
Reads10%
Reads10%
Reads10%
Reads10%
Reads10%
Reads10%
Reads10%
Reads10%
Writes10%
Reads10%
Reads10%
Writes10%
Reads10%
Reads10%
Writes10%
Reads10%
Reads10%
Writes10%
Reads10%
Reads10%
Writes10%
Reads10%
Reads10%
Writes10%
Reads10%
Reads10%
Writes10%
Reads10%
Reads10%
Writes10%
Reads10%
Reads10%
Writes10%
Reads10%
Writes10%
Reads10%
Reads
90%
Writes10%
Primary
Writes10%
Replica1
Writes10%
Replica2
Writes10%
Replica3
Writes10%
Replica4
1X
2X
3X
SCALE

21. Writes 20%
Writes 20%
Writes 20%
Writes 20%
Reads
80%
Reads 20%
Reads 20%
Reads 20%
Reads 20%
Reads 20%
Writes 20%
Reads 20%
Writes 20%
Reads 20%
Writes 20%
Reads 20%
Writes 20%
Writes 20%
Writes20%
Primary
Replica1
Replica2
Replica3
Replica4
1X
2X
SCALE

22. 50%
40%
30%
20%
10%
1
2
3
4
5
6
7
8
1
2
4
8
16
32
Scale
Scale based on % Write

23. 4x
Load buffer pool
Dump buffer pool

24. 0
5000
10000
15000
20000
25000
30000
10
30
50
70
90
110
130
150
170
190
210
230
250
270
290
310
330
350
370
390
410
430
450
470
490
510
530
550
570
590
610
630
650
670
690
Transactions per Second
Time (sec)
Workload with 50/50 R/W ratio
Unwarmed Cache
Warmed Cache
4X
9 min

26. mysql> CREATE EVENT ‘evt_dump_innodb_cache’
ON SCHEDULE EVERY 1 HOUR STARTS ‘2014-11-06 01:00:00’
DO BEGIN
CALL mysql.rds_innodb_buffer_pool_dump_now();
END

27. Considerations
Options

28. Read Only Replica
Primary
R2
Master
R/W
mysql> ALTER TABLE customers_addressADD COLUMN province VARCHAR(100);

30. pt-online-schema-change --alter "ADD COLUMN province VARCHAR(100)" --execute h=localhost,D=bench,t=customers_ address,u=admin,p=admin

36. 0
1000
2000
3000
4000
5000
6000
7000
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
Transactions per Second (TPS)
Hours
100% Read -20GB data
db.m1.medium + 200GB standard
$0.575 per hour

37. 0
1000
2000
3000
4000
5000
6000
7000
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
Transactions per Second (TPS)
Hours
100% Read -20GB data
db.m1.medium + 200GB standard
db.m3.medium + 200G + 2000 IOPS
$0.575 per hour
$0.408 per hour

38. 0
1000
2000
3000
4000
5000
6000
7000
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
Transactions per Second (TPS)
Hours
100% Read -20GB data
db.m1.medium + 200GB standard
db.m3.medium + 200G + 2000 IOPS
db.m3.large + 200G + 2000 IOPS
$0.575 per hour
$0.408 per hour
$0.508 per hour

39. 0
1000
2000
3000
4000
5000
6000
7000
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
Transactions per Second (TPS)
Hours
100% Read -20GB data
db.m1.medium + 200GB standard
db.m3.medium + 200G + 2000 IOPS
db.m3.large + 200G + 2000 IOPS
db.t2.medium + 200GB gp2
$0.105 per hour
$0.575 per hour
$0.408 per hour
$0.508 per hour

40. 0
1000
2000
3000
4000
5000
6000
7000
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
Transactions per Second (TPS)
Hours
100% Read -20GB data
db.m1.medium + 200GB standard
db.m3.medium + 200G + 2000 IOPS
db.m3.large + 200G + 2000 IOPS
db.t2.medium + 200GB gp2
db.t2.medium + 1TB gp2
$0.105 per hour
$0.575 per hour
$0.233 per hour
$0.408 per hour
$0.508 per hour

41. http://bit.ly/awsevals