These are the slides that I presented at Percona Live London, 4th Dec 2012. We have announced the new Administrator Console as part of the SkySQL Cloud Data Suite, now available for download on your laptops and linux desktops.

1. SkySQL Data Suite
A New Open Source Approach to MySQL Distributed Systems
Ivan Zoratti
V1212.01
Wednesday, 5 December 12

2. Who is Ivan
?
Wednesday, 5 December 12

3. SkySQL
•#1 provider of MySQL-based
solutions, for software and
services
•Backed by Monty Program AB
and 3rd parties active in the
MySQL ecosystem
•Committed to provide the best
solutions around MySQL for the
Community and for the
Enterprise
Wednesday, 5 December 12

4. Agenda
• SkySQL Cloud Data Suite Architecture
• SkySQL Cloud Data Suite on Amazon EC2
• Components for automated provisioning in AWS
• Components for high availability in EC2
• The Administration Console
• Automated Backup/Restore with S3
PAGE 4
Wednesday, 5 December 12

5. Agenda We WAR
hav NIN
e lo G!
ts o
• SkySQL Cloud Data Suite Architecture f sli
de s
• SkySQL Cloud Data Suite on Amazon EC2
• Components for automated provisioning in AWS
• Components for high availability in EC2
• The Administration Console
• Automated Backup/Restore with S3
PAGE 4
Wednesday, 5 December 12

6. Intro to SkySQL Data Suite
Wednesday, 5 December 12

7. SkySQL Data Suite
Replication
& MHA
High
Availability
Online Apps. Galera
Full-Text DRBD
Shared
Storage
SkySQL Data Suite Analytics
Carrier Grade
PAGE 6
Wednesday, 5 December 12

8. SkySQL Cloud Data Suite
Replication
High
Availability
Online Apps. Galera
Full-Text DRBD
Shared
Storage
SkySQL Data Suite Analytics
Carrier Grade
PAGE 7
Wednesday, 5 December 12

9. Cloud Data Suite
vs
Enterprise Data Suite
Cloud Data Suite Enteprise Data Suite
•Deployed in Amazon AWS •Deployed in Clouds, virtualised env. and bare OS
•Automatic configuration and provisioning •Standard download packages
•MariaDB 5.5 •MariaDB, MySQL, Percona Servers
•MySQL Replication with Pacemaker/Corosync •MySQL Replication with MHA, DRBD, Galera or
shared storage and Pacemaker/Corosync
•Administration Console with Backup/Restore •ZManda Recovery Manager
•SkySQL Enterprise Monitoring aka MONyog - Trial •SkySQL Enterprise Monitory aka MONyog
•PhpMyAdmin •SQLyog
•Community Support •Enterprise Technical Support
•Development Release •Production Release
•Fully OSS (with MONyog Trial) •Mix of OSS and Commercial
PAGE 8
Wednesday, 5 December 12

10. SkySQL Cloud Data Suite Sep 2012
1
1. Configure your DB system on
config.skysql.com or cloud.skysql.com
3
2. Deploy the DB system: 2
• Online
• Configuration pull from AWS
• Manually
3. Connect the DB system to
your application
PAGE 9
Wednesday, 5 December 12

11. SkySQL Data Suite Dec 2012
• Rel. 1.1 with bug fixing
• New Administration Console with:
• rpm package and installation on Linux OS
• Administration and monitoring of
replicated and standalone servers
• Customisable graphs
• Customisable commands
PAGE 10
Wednesday, 5 December 12

12. SkySQL Data Suite Architecture
Wednesday, 5 December 12

13. SkySQL Data Suite Configurator
User Account
AMI
PAGE 12
Wednesday, 5 December 12

14. SkySQL Data Suite Configurator
User Account
Configuration
Engine
AMI
Rules
Repository
PAGE 12
Wednesday, 5 December 12

15. SkySQL Data Suite Configurator
User Account
Configuration
Engine
AMI
Rules
Repository
Provisioning
Queue
PAGE 12
Wednesday, 5 December 12

16. SkySQL Data Suite Configurator
User Account
Configuration Provisioning
Engine Engine
AMI
Rules Software
Repository Repository
Provisioning
Queue
PAGE 12
Wednesday, 5 December 12

17. SkySQL Data Suite Configurator
User Account
Configuration Provisioning
Engine Engine
AMI
Rules Software
Repository Repository
Provisioning Deployment
Queue Queue
PAGE 12
Wednesday, 5 December 12

18. SkySQL Data Suite Configurator
User Account
Configuration Provisioning Deployment
Engine Engine Engine
AMI
Rules Software
Repository Repository
Provisioning Deployment
Queue Queue
PAGE 12
Wednesday, 5 December 12

19. SkySQL Data Suite Configurator
Deployment triggered by the
first boot of each instance
User Account
Database
Database Database Database Database
Configuration Provisioning Deployment
Engine Engine Engine user
da ta.s
h
AMI
Rules Software
Repository Repository
Provisioning Deployment
Queue Queue
PAGE 12
Wednesday, 5 December 12

20. SkySQL Data Suite Configurator
Deployment triggered by the
first boot of each instance
User Account
Database
Database Database Database Database
Configuration Provisioning Deployment
Engine Engine Engine user
da ta.s
h
AMI
Rules Software
Repository Repository
Provisioning Deployment
Queue Queue
PAGE 12
Wednesday, 5 December 12

21. SkySQL Cloud Data Suite
Terminal
$ ssh -i SDS193500.pem ec2-user@174.129.202.133
[ec2-user@node1 ~]$ ps -ef
UID PID PPID C STIME TTY TIME CMD
root 1157 1 0 Nov29 ? 00:00:02 /usr/sbin/glusterd --pid-file=/var/run/glusterd.pid
root 1840 1 2 Nov29 ? 00:11:34 /usr/sbin/glusterfsd -s localhost --volfile-id glust...
root 1889 1 0 Nov29 ? 00:00:50 /usr/sbin/glusterfsd -s localhost --volfile-id glust...
root 1895 1 0 Nov29 ? 00:00:01 /usr/sbin/glusterfs -s localhost --volfile-id gluste...
root 1901 1 0 Nov29 ? 00:00:01 /usr/sbin/glusterfs -s localhost --volfile-id gluste...
root 4484 1 8 Nov29 ? 00:36:13 /usr/sbin/glusterfs --volfile-id=/gluster-monyog --...
...
root 1311 1 0 Nov29 ? 00:00:34 corosync
220 1317 1311 0 Nov29 ? 00:00:12 /usr/libexec/pacemaker/cib
root 1318 1311 0 Nov29 ? 00:00:05 /usr/libexec/pacemaker/stonithd
root 1319 1311 0 Nov29 ? 00:00:12 /usr/lib64/heartbeat/lrmd
220 1320 1311 0 Nov29 ? 00:00:03 /usr/libexec/pacemaker/attrd
220 1321 1311 0 Nov29 ? 00:00:01 /usr/libexec/pacemaker/pengine
220 1322 1311 0 Nov29 ? 00:00:05 /usr/libexec/pacemaker/crmd
...
root 1534 1 0 Nov29 ? 00:00:00 sendmail: accepting connections
smmsp 1542 1 0 Nov29 ? 00:00:00 sendmail: Queue runner@01:00:00 for /var/spool/clientmqueue
...
root 2293 1 0 Nov29 ? 00:00:00 /bin/sh /usr/bin/mysqld_safe --defaults-file=/etc/my.cnf --p...
mysql 2791 2293 0 Nov29 ? 00:00:28 /usr/sbin/mysqld --defaults-file=/etc/my.cnf --basedir=/usr ...
...
root 3467 1 0 Nov29 ? 00:00:01 /usr/sbin/httpd -DSTATUS -f /etc/httpd/conf/httpd.conf
apache 25416 3467 0 Nov29 ? 00:00:00 /usr/sbin/httpd -DSTATUS -f /etc/httpd/conf/httpd.conf
...
root 4578 1 1 Nov29 ? 00:07:56 /usr/local/MONyog/bin/MONyog-bin -s
Admin Console
PhpMyAdmin
Database
Database Database Database Database
MONyog
PAGE 13
Wednesday, 5 December 12

22. SkySQL Data Suite Building Block
Admin Data Store
Console
Database
Database Database Database Database
Replicator
PAGE 14
Wednesday, 5 December 12

23. SkySQL Cloud Data Suite Sep 2012
Technologies and Software
FRONT END
Apache Linux 3.2
Tomcat Admin Data Store
Console (Amazon Distro)
BACK END
SQLite
Database
Database Database Database Database
MONyog
Trial
Replicator
MariaDB
PHPMyAdmin
MySQL
Pacemaker Replication
Xtrabackup GlusterFS
Corosync
PAGE 15
Wednesday, 5 December 12

24. SkySQL Cloud Data Suite Sep 2012
Data Store
Public
SkySQL AMI
Data Store
MariaDB 5.5
MyISAM, InnoDB, XtraDB, Enhanced
Optimizer, Virtual Columns
Database
Database Database Database Database
Pacemaker controls the
automatic failover
System and Data
file systems
From standalone to
1 Master + 3 Slaves
PAGE 16
Wednesday, 5 December 12

25. SkySQL Cloud Data Suite Sep 2012
Administration Console
GUI to monitor
the status of the
Cluster Admin
Console
Extended
Monitoring from
MONyog as a trial Database
Database Database Database Database
PhPMyAdmin as
graphical user tool
Automatic failover for
Backup/Restore to/ the admin and
from S3 using Start/Stop, Isolate, mysql command
monitoring servers
Xtrabackup Promote nodes line interface
PAGE 17
Wednesday, 5 December 12

26. SkySQL Cloud Data Suite Sep 2012
Replicator
Database
Database Database Database Database
Replicator
PAGE 18
Wednesday, 5 December 12

27. SkySQL Cloud Data Suite Sep 2012
Replicator
Database
Database Database Database Database
Replicator
Standard MySQL Replication in
asynchronous and semi-
synchronous mode
PAGE 18
Wednesday, 5 December 12

28. SkySQL Cloud Data Suite Sep 2012
Replicator
Database
Database Database Database Database
Replicator
Standard MySQL Replication in
asynchronous and semi- GlusterFS on ext4 to replicate the
synchronous mode data collection and monitoring
PAGE 18
Wednesday, 5 December 12

29. SkySQL Cloud Data Suite Sep 2012
Replicator
Database
Database Database Database Database
Replicator
Standard MySQL Replication in Automatic failover of database
asynchronous and semi- GlusterFS on ext4 to replicate the servers and console components
synchronous mode data collection and monitoring
PAGE 18
Wednesday, 5 December 12

30. SkySQL Data Suite Provisioning
User Account
Database
Database Database Database Database
user
da ta.s
h
I
AM
PAGE 19
Wednesday, 5 December 12

31. SkySQL Data Suite Provisioning
User Account
Variable definition - they will
be used later when other
scripts are called Database
Database Database Database Database
user
da ta.s
h
I
AM
PAGE 19
Wednesday, 5 December 12

32. SkySQL Data Suite Provisioning
User Account
Variable definition - they will
be used later when other
scripts are called Database
Database Database Database Database
user
On-the-fly configuration da ta.s
h
files, such as my.cnf
I
AM
PAGE 19
Wednesday, 5 December 12

33. SkySQL Data Suite Provisioning
User Account
Variable definition - they will
be used later when other
scripts are called Database
Database Database Database Database
user
On-the-fly configuration da ta.s
h
files, such as my.cnf
I
AM
Execute predefined
scripts already in the AMI
PAGE 19
Wednesday, 5 December 12

34. SkySQL Data Suite Provisioning
Adaptive, distributed
setup
User Account
Variable definition - they will
be used later when other
scripts are called Database
Database Database Database Database
user
On-the-fly configuration da ta.s
h
files, such as my.cnf
I
AM
Execute predefined
scripts already in the AMI
PAGE 19
Wednesday, 5 December 12

35. SkySQL Data Suite Provisioning
Elastic IP on
the Master Server
Adaptive, distributed
setup
User Account
Variable definition - they will
be used later when other
scripts are called Database
Database Database Database Database
user
On-the-fly configuration da ta.s
h
files, such as my.cnf
I
AM
Execute predefined
scripts already in the AMI
PAGE 19
Wednesday, 5 December 12

36. SkySQL Data Suite Provisioning
Elastic IP on
the Master Server
Adaptive, distributed
Currently, the Administration Console setup
is on the Master server
User Account
Variable definition - they will
be used later when other
scripts are called Database
Database Database Database Database
user
On-the-fly configuration da ta.s
h
files, such as my.cnf
I
AM
Execute predefined
scripts already in the AMI
PAGE 19
Wednesday, 5 December 12

37. SkySQL Data Suite Deployment
PAGE 20
Wednesday, 5 December 12

38. SkySQL Data Suite Deployment
Database
PAGE 20
Wednesday, 5 December 12

39. SkySQL Data Suite Deployment
Database
Database
Database
Database
Database
PAGE 20
Wednesday, 5 December 12

40. SkySQL Data Suite Deployment
Database
Database
Database
Database
Database
Database
Database
Database
Database
PAGE 20
Wednesday, 5 December 12

41. SkySQL Data Suite Deployment
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
PAGE 20
Wednesday, 5 December 12

42. SkySQL Data Suite Deployment
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
Database
PAGE 20
Wednesday, 5 December 12

43. SkySQL Data Suite Deployment
PAGE 21
Wednesday, 5 December 12

44. SkySQL Data Suite Deployment
PAGE 21
Wednesday, 5 December 12

45. SkySQL Data Suite Deployment
PAGE 21
Wednesday, 5 December 12

46. Automated Provisioning in AWS
Wednesday, 5 December 12

47. Starting Here!
You can try it for FREE!
Even without an
AWS account
PAGE 23
Wednesday, 5 December 12

48. Simplified Interface
Immediate Help
Real Time Check
PAGE 24
Wednesday, 5 December 12

49. Advanced Configuration
PAGE 25
Wednesday, 5 December 12

50. Cost Estimation
PAGE 26
Wednesday, 5 December 12

51. Delivery Mechanism
PAGE 27
Wednesday, 5 December 12

52. Online Deployment
The keys will be
discarded immediately
after the provisioning
PAGE 28
Wednesday, 5 December 12

53. Extra AWS & Contact Info
PAGE 29
Wednesday, 5 December 12

54. Welcome Email
mysql command line
Administration Console
ssh connection
How to remove SCDS
An inventory of the AWS
components
IMPORTANT!
Your pem key
PAGE 30
Wednesday, 5 December 12

55. Job Done!
PAGE 31
Wednesday, 5 December 12

56. SkySQL Cloud Data Suite in Amazon EC2
Wednesday, 5 December 12

57. Security
Identity Access Manager Roles
• EIP Address
• Associate/Disassociate, Describe
• Instances
• Start, Stop, Describe
• Attributes, Status, Tags, Net IF
• Create, Describe
• S3 Buckets
• List, Create, Delete
• Objects
• Get, Put, List, Delete
PAGE 33
Wednesday, 5 December 12

58. Security
Security Groups
• ssh
• http
• MySQL
• MONyog
PAGE 34
Wednesday, 5 December 12

59. Storage
PAGE 35
Wednesday, 5 December 12

60. Components for High Availability in EC2
Wednesday, 5 December 12

61. Automatic Failover with Pacemaker
CRM Configuration
Admin Data Store
Console
Database
Database Database Database
Replicator
PAGE 37
Wednesday, 5 December 12

62. Automatic Failover with Pacemaker
CRM Configuration
Admin Data Store
Console
Database
Database Database Database
Replicator
PAGE 37
Wednesday, 5 December 12

63. Automatic Failover with Pacemaker
CRM Configuration
Admin Data Store
Console
Database
Database Database Database
Replicator
PAGE 37
Wednesday, 5 December 12

64. Automatic Failover with Pacemaker
CRM Configuration
Admin Data Store
Console
Database
Database Database Database
Replicator
PAGE 37
Wednesday, 5 December 12

65. Automatic Failover with Pacemaker
CRM Configuration
Admin Data Store
Console
Database
Database Database Database
Replicator
PAGE 37
Wednesday, 5 December 12

66. Automatic Failover with Pacemaker
CRM Configuration Elastic IP
admin-console and
[root@node2 init.d]# crm status Node 2
============ MONyog group
Last updated: Sat Dec 1 12:42:03 2012
Last change: Fri Nov 30 12:43:27 2012 via crm_attribute on node2
Stack: openais
Current DC: node2 - partition with quorum Public IPs
Version: 1.1.7-6.el6-148fccfd5985c5590cc601123c6c16e966b85d14
4 Nodes configured, 4 expected votes
14 Resources configured.
============
Online: [ node2 node3 node1 node4 ] Admin Data Store
Console
Master/Slave Set: ms_resMySQL [resMySQL]
Masters: [ node2 ]
Slaves: [ node1 node3 node4 ]
AmazonEIP (lsb:amazon_master_eip): Started node2
Clone Set: apache-php-myadmin [ApachePhpMyAdmin]
Started: [ node1 node2 node3 node4 ]
Resource Group: monyog Database
Database Database Database
monyog-fs (ocf::custom:Filesystem): Started node2
monyog-service (lsb:MONyogd): Started node2
Resource Group: admin-console
console-fs (ocf::custom:Filesystem): Started node2
SkySQL-monitor (lsb:skysql_monitor): Started node2
Tomcat7 (ocf::heartbeat:tomcat): Started node2
Replicator
PAGE 38
Wednesday, 5 December 12

67. The Administration Console
Wednesday, 5 December 12

68. Admin Console Dec 2012
PAGE 40
Wednesday, 5 December 12

69. Admin Console Dec 2012
Master
Server
Access to
MONyog
Context
Sensitive
Customisable
Graphs
PAGE 41
Wednesday, 5 December 12

70. Admin Console Dec 2012
Backup/Restore
Access to
PhpMyAdmin
Customisable
Commands
PAGE 42
Wednesday, 5 December 12

71. Administration Console Dec 2012
Customizable Graphs
Monitors
Name SQL Icon Delta Avg Chart
PAGE 43
Wednesday, 5 December 12

72. Administration Console Dec 2012
Customizable Commands
Commands
Desc Icon Order
CommandStep
Steps
Desc Icon Script
PAGE 44
Wednesday, 5 December 12

73. Automated Backup/Restore with S3
Wednesday, 5 December 12

74. Automated Backup
Using Xtrabackup from the Admin Console
PAGE 46
Wednesday, 5 December 12

75. Automated Backup
Using Xtrabackup from the Admin Console
PAGE 47
Wednesday, 5 December 12

76. Automated Backup
Using Xtrabackup from the Admin Console
PAGE 48
Wednesday, 5 December 12

77. Why is the SkySQL Cloud Data Suite
important for you?
• You can test MariaDB/MySQL on AWS for
FREE
• You can use and fully control a ready made
highly available solution AWS
• You can compare MySQL on EC2 and RDS
• You can study/review security and
availability aspects in AWS
• You can use some of the SCDS
components in your environment
PAGE 49
Wednesday, 5 December 12

78. For more information...
• Try the Configurator and How-To Video: http://
cloud.skysql.com
• The Admin Console: http://www.skysql.com/
downloads/community/skysql-console
• Forums: https://www.skysql.com/forums/
skysql-cloud-data-suite
• Web: https://www.skysql.com/cloud
• Bugs: http://bugs.skysql.com
• Try it! http://config.skysql.com
• Free SkySQL account available for testing
• Test on your account
PAGE 50
Wednesday, 5 December 12

79. Thank You!
ivan@skysql.com
www.skysql.com izoratti.blogspot.com
www.slideshare.net/izoratti
Wednesday, 5 December 12