CloudStack European User Group Meetup in London Jan 2014. Presentation by Paul Angus

1. Ansible & CloudStack
Configuration Management
Paul Angus
Cloud Architect
paul.angus@shapeblue.com
@CloudyAngus
@ShapeBlue

2. Ansible & CloudStack
Configuration Management
Ansible
Using Ansible with CloudStack
shapeblue.com

3. About Me
Who am I
Cloud Architect with ShapeBlue
Worked with CloudStack since 2.2.13
Specialising in deployment of CloudStack
and surrounding infrastructure
Orange, TomTom, PaddyPower, Ascenty, BSkyB
I view CloudStack from ‘What can cloud
consumers practically do with it’ point-of-view
shapeblue.com

4. shapeblue.com

5. About ShapeBlue
“ShapeBlue are expert builders of public &
private clouds. They are the leading global
independent CloudStack / CloudPlatform
integrator & consultancy”
shapeblue.com

6. Ansible & CloudStack
What is Configuration
Management?
shapeblue.com

7. What is Configuration Management?
Configuration management is the philosophy of
defining the state that a server should be in wrt it’s
configuration and using tools that achieve that state
CM gives centralisation of configuration data and
actions
Configuration Management tools should be
idempotent
shapeblue.com

8. Er, Idempotent?
Operations in mathematics and computer science, that can be
applied multiple times without changing the result beyond the
initial application.
(you asked)
shapeblue.com

9. Er, Idempotent?
CloudStack Example:
You need to add the following lines to the default my.cnf:
innodb_rollback_on_timeout=1
innodb_lock_wait_timeout=600
max_connections=350
A sed command would add the lines
sed -i -e '/symbolic-links=0/ ainnodb_rollback_on_timeout=1' -e '/symbolic-links=0/
ainnodb_lock_wait_timeout=600' -e '/symbolic-links=0/ amax_connections=350' /etc/my.cnf
But if you needed to run your script to update/restore another setting then the addition of these lines
would be repeated
A configuration management tool would not add these lines again if rerun.
shapeblue.com

10. Er, Idempotent?
CloudStack Example:
In a configuration management you would specify that these lines:
innodb_rollback_on_timeout=1
innodb_lock_wait_timeout=600
max_connections=350
should exist in the my.cnf file
The configuration management tool would only add these lines if they don’t exist.
shapeblue.com

11. What is Configuration Management?
I need these services to be installed and running
I need this configuration file to contain these lines
I need this file to exist in this directory
Centralisation of configuration
Creation of reusable template configurations
i.e. web servers, database servers, DHCP servers, CloudStack
management servers
shapeblue.com

12. Ansible & CloudStack
Ansible
shapeblue.com

13. Why Ansible
Technical:
Client/Server architecture not required
Only SSH connectivity required (password or public/private keys)
…making it easier to deploy in environments
Modules can be in any language capable of returning JSON or key=value text pairs
Has an API
User:
Much shallower learning curve
Don’t need to learn a programming language (i.e. Ruby)
Not as many pre-existing playbooks (recipes/manifests) about, but improving with Ansible Galaxy
shapeblue.com

14. Ansible & CloudStack
Where to use Ansible
shapeblue.com

15. Where to Use Ansible
Building CloudStack RPMs from source
Deploying management infrastructure
Deploying hosts
Configuration changes to hosts and management VMs
Patching of hosts and management VMs
Deployment & configuration of guest VMs
shapeblue.com

16. Ansible & CloudStack
How to use Ansible
shapeblue.com

17. How to use Ansible
Host Inventories
Roles
Tasks
Variables (hosts or groups)
Modules
Templates
Playbooks
shapeblue.com

18. Installing Ansible
# rpm -ivh
http://www.mirrorservice.org/sites/dl.fedoraproject.org/pub/epel/6/i386/epelrelease-6-8.noarch.rpm
# yum install -y python-pip
# pip install ansible
Directory /etc/ansible is created
shapeblue.com

19. Creating an Ansible ‘Server’
Install
Ansible
git pull
‘ansible-repo’
shapeblue.com

20. Building of RPMs from Source
David Nalley @ke4qqq
http://buildacloud.org/blog/312-building-cloudstack-rpms-withansible.html
shapeblue.com

21. Ansible & CloudStack
Using Ansible with
CloudStack
shapeblue.com

22. Using Ansible with Guest VMs
Use Ansible to create
guest VMs
Create/deploy Ansible
server environment
Use Ansible to configure
guest VMs
Use Ansible to maintain
guest VMs
•CloudMonkey
•CloudStack/Ansible module
(WIP)
•EC2 module?
•Dynamic Inventories
•Call back
•Roles
•UserData + ansible-pull
•Dynamic Inventories
•Playbooks
shapeblue.com

23. Dynamic Inventories
Dynamic Inventories:
EC2 (use for CloudStack?)
Cobbler
BSD Jails
Digital Ocean
Linode
OpenShift
OpenStack Nova
Red Hat's SpaceWalk
Vagrant (not to be confused with the provisioner in vagrant)
Zabbix
AnsibleWorks AWX also provides a database to store inventory results that is both web and REST Accessible.
AWX syncs with all Ansible dynamic inventory sources.
shapeblue.com

24. Using Ansible with Guest VMs
A toolset is required to determine that a new webserver etc
is required and to tell Ansible to create and configure it.
shapeblue.com

25. Ansible & CloudStack
Deploying a CloudStack
Management Server
shapeblue.com

26. CloudStack Management Server
Prereqs
Creating roles, templates, tasks & playbooks
shapeblue.com

27. Pre-Requisites
A CentOS 6.4 host to install CloudStack on and one for Ansible
An IP address already assigned on the ACS management host
The ACS management host should have a resolvable FQDN (either
through DNS or the host file on the ACS management host)
Internet connectivity on the ACS management host
shapeblue.com

28. CloudStack Management Server
Create MySQL role
Create CloudStack role
Create DB deployment task
Create Seed secondary storage task
Create Playbook
shapeblue.com

29. Create MySQL role
/etc/ansible/roles/mysql/tasks/main.yml
--- name: Ensure mysql server is installed
yum: name=mysql-server state=present
- max_connections=350
- log-bin=mysql-bin
- binlog-format = 'ROW'
- name: Ensure mysql python is installed
yum: name=MySQL-python state=present
- name: Ensure MySQL service is started
service: name=mysqld state=started
- name: Ensure selinux python bindings are installed
yum: name=libselinux-python state=present
- name: Ensure MySQL service is enabled at boot
service: name=mysqld enabled=yes
- name: Ensure cloudstack specfic my.cnf lines are present
lineinfile: dest=/etc/my.cnf regexp='$item' insertafter="symbolic-links=0"
line='$item'
with_items:
- skip-name-resolve
- default-time-zone='+00:00'
- innodb_rollback_on_timeout=1
- innodb_lock_wait_timeout=600
- name: Ensure root password is set
mysql_user: user=root password=$mysql_root_password host=localhost
ignore_errors: true
- name: Ensure root has sufficient privileges
mysql_user: login_user=root login_password=$mysql_root_password
user=root host=% password=$mysql_root_password priv=*.*:GRANT,ALL
state=present
shapeblue.com

30. Create CS Manger role
/etc/ansible/roles/cloudstack-management/tasks/main.yml
--- name: Ensure selinux python bindings are installed
yum: name=libselinux-python state=present
get_url: url=http://download.cloud.com.s3.amazonaws.com/tools/vhd-util
dest=/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/vhdutil mode=0755
- name: Ensure the Apache Cloudstack Repo file exists as per template
template: src=cloudstack.repo.j2 dest=/etc/yum.repos.d/cloudstack.repo
- name: Ensure selinux is in permissive mode
command: setenforce permissive
- name: Ensure selinux is set permanently
selinux: policy=targeted state=permissive
- name: Ensure CloudStack packages are installed
yum: name=cloudstack-management state=present
- name: Ensure vhdutil is in correct location
shapeblue.com

31. Create CS Repo Template
/etc/ansible/roles/cloudstack-manager/templates/cloudstack.repo.j2
name=cloudstack
baseurl=http://${baseurl_cloudstack}
enabled=1
gpgcheck=0
shapeblue.com

32. Create DB Deployment Task
/etc/ansible/roles/cloudstack-management/tasks/setupdb.yml
--- name: cloudstack-setup-databases
command: /usr/bin/cloudstack-setup-databases cloud:{{
mysql_cloud_password }}@{{mysql_vip}} --deploy-as=root:{{
mysql_root_password }}
- name: Setup CloudStack manager
command: /usr/bin/cloudstack-setup-management
shapeblue.com

33. Create Seed Secondary Storage Task
/etc/ansible/roles/cloudstack-manager/tasks/seedstorage.yml
--- name: Ensure secondary storage mount exists
file: path={{ tmp_nfs_path }} state=directory
- name: Ensure NFS storage is mounted
mount: name={{ tmp_nfs_path }} src={{ sec_nfs_ip }}:{{ sec_nfs_path }}
fstype=nfs state=mounted opts=nolock
command: /usr/share/cloudstackcommon/scripts/storage/secondary/cloud-install-sys-tmplt -m {{
tmp_nfs_path }} -u
http://download.cloud.com/templates/4.2/systemvmtemplate-4.2-vh7.ova h vmware -F
- name: Seed secondary storage
command: /usr/share/cloudstackcommon/scripts/storage/secondary/cloud-install-sys-tmplt -m {{
tmp_nfs_path }} -u
http://download.cloud.com/templates/4.2/systemvmtemplate-2013-06-12master-kvm.qcow2.bz2 -h kvm -F
command: /usr/share/cloudstackcommon/scripts/storage/secondary/cloud-install-sys-tmplt -m {{
tmp_nfs_path }} -u
http://download.cloud.com/templates/4.2/systemvmtemplate-2013-07-12master-xen.vhd.bz2 -h xenserver -F
shapeblue.com

34. Create Playbook
/etc/ansible/deploy-cloudstack.yml
--- hosts: acs-manager
vars:
mysql_vip: localhost
mysql_root_password: Cl0ud5tack
mysql_cloud_password: Cl0ud5tack
tmp_nfs_path: /mnt/secondary
sec_nfs_ip: IP_OF_YOUR_SECONDARY_STORAGE
sec_nfs_path: PATH_TO_YOUR_SECONDARY_STORAGE_MOUNT
baseurl: cloudstack.apt-get.eu/rhel/4.2/
roles:
- mysql
- cloudstack-manager
- include: /etc/ansible/roles/cloudstack-manager/tasks/seedstorage.yml
tasks:
- include: /etc/ansible/roles/cloudstack-manager/tasks/setupdb.yml
shapeblue.com

35. Demonstration
shapeblue.com

36. XenServer Hotfixes
Requires the use of Ansible ‘facts’ (until a XenServer module
is written)
shapeblue.com

37. Ansible Facts
Written as ‘modules’ in any language that is present on the
client
Result should be an output in JSON format
shapeblue.com

38. Ansible Facts
/etc/ansible/roles/xenserver/tasks/updatexenserver.yml
#!/bin/bash
# create a JSON compatible Ansible 'Fact' of patches installed on a XenServer
uuid=$uploaded_patch --minimal` ]]; then
XENVERSION=`cat /etc/redhat-release | awk -F ' ' '{print $3}' | awk -F '-' '{print $1}'`
VER=${XENVERSION//./_}
THIS_HOST=`xe host-list --minimal name-label=$HOSTNAME`
listUploadedPatches=`xe patch-list --minimal`
# output opening section of JSON output
echo '{
"ansible_facts": {'
# output XenServer version
echo "
echo '
echo "
"`xe patch-param-get param-name=name-label
uuid=$uploaded_patch`": "installed"," >> /tmp/ansi_answ_file
else
echo "
"`xe patch-param-get param-name=name-label
uuid=$uploaded_patch`": "uploaded"," >> /tmp/ansi_answ_file
fi
done
# remove training comma on last entry in file (then output contents)
sed '$s/.$//' /tmp/ansi_answ_file
"ansible_xenserver_version": "$VER","
"ansible_xenserver_patches": {'
if [ -n "$listUploadedPatches" ]; then
# split comma separated list into an array
UploadedPatches=${listUploadedPatches//,/$'n'}
# remove file
rm -f /tmp/ansi_answ_file
fi
# loop through uploaded patches and output to a temp file
for uploaded_patch in $UploadedPatches
do
if [[ -n `xe patch-list hosts=$THIS_HOST
# output closing part of JSON output
echo "
}
}"
shapeblue.com
}

39. Facts
[root@XS62-2 tmp]# /root/facts.sh
{
"ansible_facts": {
"ansible_xenserver_version": "6_2_0",
"ansible_xenserver_patches": {
"XS62E004": "uploaded",
"XS62E001": "installed",
"XS62E002": "installed"
}
}
}
shapeblue.com

40. Create Update XenServer Task
/etc/ansible/group_vars
baseurl_cloudstack: cloudstack.apt-get.eu/rhel/4.2/
pkg_server_datapath: http://fileserver.angusnet.local
ss_servers:
- 10.0.100.5
- 10.0.100.6
hotfixes-6_2_0:
- XS62E001
- XS62E002
- XS62E004
/etc/ansible/hosts
[xenserver_hosts]
xs62-1.angusnet.local hostname=xs62-1 mgmt_ip=10.34.149.190 storage_nic_ip=10.78.234.3 macaddr=d8:9d:67:14:20:f0 pxemac=01-d8-9d-67-14-20-f0
xs62-2.angusnet.local hostname=xs62-2 mgmt_ip=10.34.149.191 storage_nic_ip=10.78.234.4 macaddr=d8:9d:67:14:2b:14 pxemac=01-d8-9d-67-14-2b-14
shapeblue.com

41. Create Update XenServer Task
/etc/ansible/roles/xenserver/tasks/update_xenserver.yml
--- name: Determine updated and installed patches
action: get_xenserver_facts
- name: Determine updated and installed patches
action: get_xenserver_facts
- name: Uploading patch $item to XenServer pool
- name: Copying xsupdate files to host
shell: "/opt/xensource/bin/xe patch-upload file-name=/tmp/$item.xsupdate"
copy: src={{ pkg_server_datapath }}/xenupdates/{{ ansible_xenserver_version }}/{{ with_items:
item }}.xsupdate dest=/tmp/
- ${hotfixes-{{ ansible_xenserver_version }}}
with_items:
only_if: "{{ item not in ansible_xenserver_patches }}"
- ${hotfixes-{{ ansible_xenserver_version }}}
only_if: "{{ item not in ansible_xenserver_patches }}"
- name: Determine updated and installed patches
action: get_xenserver_facts
- name: Copying '-src-pkgs.tar.bz2' files to host if they exist
action: copy src="{{ pkg_server_datapath }}/xenupdates/{{
ansible_xenserver_version }}/{{ item }}-src-pkgs.tar.bz2" dest=/tmp/
with_items:
- ${hotfixes-{{ ansible_xenserver_version }}}
only_if: "{{ item not in ansible_xenserver_patches }}"
ignore_errors: true
- name: Applying $item
shell: "/opt/xensource/bin/xe patch-apply host-uuid=`xe host-list --minimal namelabel=$HOSTNAME` uuid=`xe patch-list name-label=$item --minimal`"
with_items:
- ${hotfixes-{{ ansible_xenserver_version }}}
only_if: "'{{ ansible_xenserver_patches[item] }}' != 'installed'"
shapeblue.com

42. Questions
?
shapeblue.com

43. Resources
Slides: www.slideshare.net/shapeblue
Blogs: http://shapeblue.com/blog/
Email: paul.angus@shapeblue.com
Twitter: @CloudyAngus
Web: http://shapeblue.com
http://cloudstack.apache.org/
shapeblue.com

44. Ansible & CloudStack
Configuration Management
Paul Angus
Cloud Architect
paul.angus@shapeblue.com
@CloudyAngus
@ShapeBlue