NETWAYS is using OpenNebula in their multi-customer cloud for years now. Having the roots in a typical XEN replacement, more and more cloud functionalities are used in production now. The system is heavily coupled with Puppet and all other internal systems like monitoring, backup and accounting. The talk will focus on the hurdles taken in the last years starting with various design considerations and different steps made to achieve the “final” architecture NETWAYS is using today. It’ will also give a detailed view onthe current setup and connected subsystems. Bio: Bernd Erk, Managing Director, has overseen the Managed Services, Consulting and Development business areas at NETWAYS since 2007. Ensuring the success and smooth operation of all customer projects and business processes, Bernd’s technical expertise stretches across Systems Management, Managed Services and Software Development. A contributor to Linux Magazine and Linux Technical Review in Germany, Bernd regularly publishes articles and presents on open source topics ranging across Icinga monitoring, MySQL database monitoring, OpenNebula Cloud framework and performance tuning among others. Bernd was previously Operating Systems Specialist at Quelle Schickedanz AG & Co., where he worked heavily with Solaris, HPUX and Oracle databases. After which, Bernd spent 8 years as Business Unit Manager at Ise-Informatik where he dealt with Oracle databases and service oriented architectures.

1. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
OPENNEBULACONF – 25TH OCTOBER 2013
OPENNEBULA IN A MULTI-
CUSTOMER ENVIRONMENT
BERND ERK | NETWAYS GMBH

2. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
AGENDA
￭ Introduction
￭ Use case & Requirements
￭ History
￭ Today‘s Architecture
￭ Configuration Management
￭ Monitoring & Reporting
￭ Coming up
￭ Questions & Answers

3. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
INTRODUCTION NETWAYS
• Founded 1995
• Open Source since 1997
• 40 Employees
• Specialized in Open Source
Systems Management and Open
Source Datacenter Infrastructure
Searching for awesome people!

4. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
NETWAYS COMPETENCIES
• Monitoring & Reporting
• Configuration Management
• Service Management
• Knowledge Management
• Backup & Recovery
• High Availability & Clustering
• Cloud Computing
• Load Balancing
• Virtualization
• Database Management
OPEN SOURCE
SYSTEMS MANAGEMENT
OPEN SOURCE
DATA CENTER
MANAGED SERVICES MONITORING HARDWARE CONFERENCES

5. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
PuppetCamp 2013/2014
• 28th November Munich
• 11th April Berlin
• CfP is still open
Open Source Datacenter Conference
• 8th – 10th April 2014
• 125 Attendees (2012)
• Datacenter | Automation | DevOps
• CfP open until 31th December 2013
OpenNebulaConf 2014
• opennebulaconf.com
• 2nd – 4th December 2014
• Berlin
NETWAYS CONFERENCES

6. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
INTRODUCTION OPENNEBULA

7. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
INTRODUCTION OPENNEBULA

8. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
USE CASE & REQUIREMENTS

9. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
USE CASE

10. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
REQUIREMENTS
￭ High Availability
• Automatic Failover
￭ Flexible Resources
• Resource allocation and accounting
• Isolation of noisy neighbours
￭ Independent Storage Architecture
• Persistent Images on existing technologies
￭ Client isolation
• Networking
• Monitoring

11. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
HISTORY

12. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
ARCHITECTURE - 2007
100% BareMetal

13. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
ARCHITECTURE - 2010
XEN
XEN
XEN
XEN
XEN
XEN
XEN
XEN
XEN
NFS on NetApp Filer

14. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
ARCHITECTURE – 2010 - PROBLEMS
￭ Missing overview
• Monitoring driven reboot
• Missing priorities
• No logic grouping on servers
￭ XEN-Problems
• Kernel in Debian
• Sometimes compatibility issues with Dell-HW
￭ No API
• Missing accounting
• Clear path for Puppet integration
XEN
XEN
XEN
XEN
XEN
XEN
XEN
XEN
XEN
NFS on
NetApp Filer

15. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
WHAT NOW?
OpenStack
OpenNebula
Nigel Beighton (Rackspace)

16. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
DEPENDS ON THE PERSPECTIVE
￭ Technical Guy
• There is a tool for every customer
￭ Sales Guy
• There is a customer for every tool

17. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
WHAT WE DID?

18. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
TODAY’S ARCHITECTURE

19. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
ARCHITECTURE - 2012

20. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
ARCHITECTURE - 2012
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
NFS on NetApp Filer

21. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
ARCHITECTURE – 2012- CHALLENGES
￭ Failover
• Split-Brain situation
￭ NetApp
• We want to get rid of it
• No financial scaling
￭ Choosing the right filesystem
• OCFS2 sucks (sometimes)
• Ceph is nearly stable
• GlusterFS implementation is not (yet) ready
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
NFS on
NetApp Filer

22. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
ARCHITECTURE – 2012- SOLUTIONS
￭ Pacemaker is controlling the stack
• Checking libvirt is important!
￭ Stonith – if something looks creepy
￭ Still working on NetAPP-NFS
￭ GlusterFS seems to be good for now
• Working on better integration in ONE
• First tests are promising
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
NFS on
NetApp Filer

23. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
REPORTING & MONITORING

24. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
MONITORING - ICINGA

25. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
MONITORING - GRAPHING

26. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
REPORTING & ACCOUNTING

27. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
REPORTING & ACCOUNTING

28. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
REPORTING & ACCOUNTING

29. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
CONFIGURATION MANAGEMENT

30. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
PUPPET
￭ Puppet
• Configuration Management based on Ruby
• Life-Cylce-Management and Provisioning
• Live Management using MCollective
￭ How it works
• Puppet DSL (Domain Specific Language)
• Abstracted through Resource Abstraction Layer
• Define -> Simulate -> Enforce - > Report

31. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
PUPPET ENTERPRISE / FOREMAN
￭ Puppet Enterprise
• Graphical Interface
• Great Live Management
￭ Foreman
• Open Source interface for Puppet
• http://theforeman.org
• Great interface and additional features like
• Unattended Installation
• Integration of cloud frameworks

32. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
FOREMAN – VIRT-HOSTS

33. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
FOREMAN – PUPPET-CLASSES

34. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
FOREMAN – PUPPET - LIFECYLE
Configurat
ion (Hiera,
PuppetDB)
Dry Run using
MCollective
Continuous
Testing
Merge
Environm
ents
Final Test
Rollout

35. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
FOREMAN – PUPPET - LOADBALANCER
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
KVM
NFS on NetApp
Filer
LB 1
LB 2

36. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
COMING UP

37. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
WHAT’S NEXT?
￭ Update OpenNebula to 4.2
￭ Using GlusterFS
• Did some first tests with new qemu-versions
• GlusterFS-Support since version 1.3
￭ Fully automated provisioning of all systems
including networking, backup and monitoring
-> Software Defined Infrastructure
￭ Kicking out NetApp-Filer
￭ Adding new Nodes :-)

38. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
QUESTIONS & ANSWERS

39. www.netways.de // blog.netways.de // @netways
We love Open Source
#opennebulaconf
NETWAYS GmbH
Deutschherrnstrasse 15-19
90429 Nuremberg
Tel: +49 911 92885-0
Fax: +49 911 92885-77
Email: info@netways.de
Website: www.netways.de
Twitter: twitter.com/netways
Facebook: facebook.com/netways
Blog: blog.netways.de
QUESTIONS & ANSWERS
THANK YOU
SEE YOU
NEXT YEAR
2ND – 4TH
DECEMBER
2014