Más contenido relacionado La actualidad más candente (20) Similar a Multi-master, multi-region MySQL deployment in Amazon AWS (20) Multi-master, multi-region MySQL deployment in Amazon AWS2. Introducing Continuent
•
The leading provider of clustering and
replication for open source DBMS
•
Our Product: Continuent Tungsten
• Clustering - Commercial-grade HA, performance
scaling and data management for MySQL
• Replication - Flexible, high-performance data
movement
©Continuent 2014
2
3. Quick Continuent Facts
•
Largest Tungsten clustering installation
processes up to 700M transactions daily
•
Over 100 customers including many
household names
•
Multiple multi-site, multi-master
deployments in production
•
... And more are on the way
©Continuent 2014
3
5. Tungsten Database-as-a-Service
GonzoPortal.com
Tungsten clusters combine offthe-shelf open source DBMS
servers into data services with:
apache
/php
!
• 24x7 data access
• Scaling of load on replicas
• Simple management commands
!
...without app changes or data
migration
Amazon
US West
©Continuent 2014
5
Connector
Connector
10. Multiple Services Per Replicator
NYC
Replicator
Service nyc
Replicator
Service nyc
Frankfurt
Service fra
Replicator
Service fra
©Continuent 2014
London
10
11. Using Services for Multi-Master
Replication
New York
Replicator
Replicator
lhr (slave)
jfk (master)
©Continuent 2014
lhr (master)
jfk (slave)
11
London
13. Why Multi-Site? Why Multi-Master?
•
•
•
Get data close to global applications
•
•
Keep running if a site fails
©Continuent 2014
Avoid latency cost of commit between sites
Keep running during intermittent network
failures between sites
Enable simple recovery when it comes back
13
14. Multi-Site Multi-Master Clustering:
the Marketecture
Amazon Region
Amazon Region
Application
Applications
Application
Applications
No app or
data coupling
across regions
Live data
and apps
in all regions
Multi-AZ
deployment
©Continuent 2014
Async replication
Run in Amazon
between sites
or on-premise
14
18. Best Practice Deployment in Amazon
Multi-AZ clustering with asynchronous multimaster across regions
AZ
US-
West-1
AZ
AZ
AZ
AZ
EU-
West-1
AZ
US-East-1
Region
©Continuent 2014
AZ
AZ
AZ
AZ
Availability Zone
18
25. What Are Replication Filters?
Master Pipeline
Stage
Extract
Filter
Stage
Apply
Extract Filter
Apply
Inspect
Change
Drop
Master
DBMS
©Continuent 2014
Transaction
History Log
25
In-Memory
Queue
26. Problem: Handling PII Data
CREATE TABLE `personal_info` (
`id` int(11) NOT NULL AUTO_INCREMENT,
`userid` varchar(250) DEFAULT NULL,
`personal_code` varchar(250) DEFAULT NULL,
`birth_date` date DEFAULT NULL,
`email` varchar(250) DEFAULT NULL,
PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8
Requirement 1: Do not replicate
personally identifiable information
©Continuent 2014
26
27. Using dropcolumns.js Built-In Filter
Master Pipeline
Stage
Extract
Filter(s)
Stage
Apply
Extract Filter
Apply
colnames
dropcolumns
Master
DBMS
Transaction
History Log
dropcolumns.json
©Continuent 2014
27
In-Memory
Queue
28. Problem: Application-Specific Rules
mysql select * from personal_info;
+----+--------+---------------+------------+-----------------+---------+
| id | userid | personal_code | birth_date | email
| newdata |
+----+--------+---------------+------------+-----------------+---------+
| 3 | fre11 | secret
| 1985-01-16 | bobr@gmail.com | new
|
| 4 | bill | verysecret
| 1995-01-16 | billk@gmail.com | newer
|
+----+--------+---------------+------------+-----------------+---------+
!
Requirement 2: prevent userid
‘bill’ from replicating
©Continuent 2014
28
29. Adding Rules using Custom Filters
•
•
Javascript vs. Java Filters
Put Javascript file in:
${replicator-home}/samples/extensions/javascript
•
Add .tpl file for your filter to:
${replicator-home}/samples/conf/filters/default
©Continuent 2014
29
32. How Do I Get Started?
•
Documentation for all products
http://docs.continuent.com
•
Download registration for Tungsten clustering:
http://www.continuent.com/downloads/software
•
Downloads for open source Tungsten Replicator
http://code.google.com/p/tungsten-replicator/
•
Vagrant project for setting up test topologies
https://github.com/continuent/continuent-vagrant/tree/master/
examples/MSMM
©Continuent 2014
32
33. 560 S. Winchester Blvd., Suite 500
San Jose, CA 95128
Tel +1 (866) 998-3642
Fax +1 (408) 668-1009
e-mail: sales@continuent.com
Our Blogs:
http://scale-out-blog.blogspot.com
http://datacharmer.org/blog
http://www.continuent.com/news/blogs
Continuent Web Page:
http://www.continuent.com
!
Tungsten Replicator:
http://code.google.com/p/tungsten-replicator
©Continuent 2014