At Maersk Line, not only the world's biggest ships 'Triple-E' class vessels are currently being built. Continuous Integration and Delivery on a similar scale using Hudson, Maven and tools like Kokki similar to Puppet or Chef are also practiced there. This session is going to give a brief overview of Multi-Configuration (Matrix) job types used in most of these projects. Things are being built and deployed in a heterogenous environment, otherwise probably found only at large vendors of Public Cloud services.

1. Triple-E’ class
Continuous Delivery
with Hudson, Maven, Kokki and
PyDev
Werner Keil
Eclipse Day Delft
27th September 2012

2. 2 © 2012 Creative Arts & Technologies Images © Maersk Line and Others

3. Overview
• Introduction
• Kokki
• Configuration
• Multiconf
• PyDev
• Development
• Maven
• Build
• Hudson
• Automation
• Demo
• Q&A
3 © 2012 Creative Arts & Technologies

4. Who am I?
Werner Keil
• Consultant – Coach
• Creative Cosmopolitan
• Open Source Evangelist
• Software Architect
• Java Godfather
• UOMo Project Lead
• …
Email werner@catmedia.us
Twitter @wernerkeil
4 © 2012 Creative Arts & Technologies

5. Kokki
• Infrastructure Automation → Configuration
Management
• Part of Provisioning
• Library and simple command line tool
• Currently no client/server component
• Can use GitHub in place of client/server
• Alternative to Puppet/Chef/Cfengine
• Implemented in Python
5 © 2012 Creative Arts & Technologies

6. Kokki | Terms
• Kokki is a configuration management framework.
• It can be used standalone or as a part of a more complex system.
• It means “cook” in Finnish
• Environment: Execution environment
• Resource: Describes a file, service, package, etc..
• Provider: Knows how to execute a resource
• Kitchen: Container for cookbooks
• Cookbook: Container for recipes and libraries
• Recipe: group of resource definitions
• Library: utility methods, resources, and providers
6 © 2012 Creative Arts & Technologies

7. Kokki | Quick Example
from kokki import *
with Environment() as env:
Package("vim", action="upgrade")
File("/etc/hosts",
owner = "root",
group = "root",
content = "127.0.0.1 localhostn"
"255.255.255.255 broadcasthostn"
"::1 localhostn"
"fe80::1%lo0 localhostn")
env.run()
7 © 2012 Creative Arts & Technologies

8. Kokki++ | Multiconf
• Multiconf is a framework for describing complex
environments using Python.
• Why
• It started from a simple need of continuous deployment of Java EE projects.
• Using a bunch of Python scripts, and a bunch of plain text property files.
• When number of property files increased number of scripts increased, too…
• Out of this dilemma Multiconf was born.
8 © 2012 Creative Arts & Technologies

9. Multiconf
• How
• Imagine a project, using multiple servers like Tomcat, Jetty, JBoss, Glassfish
or Weblogic.
• You are going to use database connections and four environments:
• Local (for developer's local machine)
• Dev
• Test
• Prod
• Project configuration will be similar on different environments, but something
will be different (databases and ports, for example).
9 © 2012 Creative Arts & Technologies

10. Multiconf (2)
• What Multiconf is not
• Multiconf itself doesn't know how to create environments.
• Multiconf doesn't know how to create any of the environment's components
• Multiconf has nothing to execute
• Perfect match for a system such as Kokki
• Same language
• Pluggable recipes and Libraries make Kokki open to such Extensions
• What Multiconf is
• Multiconf allows you to define your software stack and get early warning that
something within your definition is wrong. Other tools use YAML or JSON to
define settings of the components, but then you need something to validate
those settings. Multiconf is both - definition and validation.
10 © 2012 Creative Arts & Technologies

11. Multiconf | JSF Example
from javax_faces import ProjectStage
from valid_envs import local, dev, test, pp, prod
def jsf_stages():
with ProjectStage() as ps:
ps.name(local=”Development”,
dev=”Development”,
test=”UnitTest”,
pp=”SystemTest”,
prod=”Production”)
11 © 2012 Creative Arts & Technologies

12. PyDev
• PyDev is a product of Appcelerator, a platform
and services company that is enabling Web
developers to build cross-platform / native
applications for Mobile, Tablet and Desktop
platforms
Winner of 2011 Eclipse Award
for Best Developer Tool
Appcelerator also makes Aptana Studio and
Titanium Studio, Eclipse-based IDEs targeting
Web and Mobile platforms.
12 © 2012 Creative Arts & Technologies

13. PyDev | Code Completion
13 © 2012 Creative Arts & Technologies

14. PyDev | Code Navigation
14 © 2012 Creative Arts & Technologies

15. PyDev | Code Coverage
15 © 2012 Creative Arts & Technologies

16. PyDev | Debugging
16 © 2012 Creative Arts & Technologies

17. PyDev | Unit Tests
17 © 2012 Creative Arts & Technologies

18. PyDev
DEMO

19. Maven
The evolution of build systems
19 © 2012 Creative Arts & Technologies

20. Maven
“Lean” Usage
• Using Maven for what it‟s Best at
• Dependency Management
• Nexus
• Managed Environment
• Generated / Called by Kokki
• Hudson Plugins
20 © 2012 Creative Arts & Technologies

21. Hudson
• Hudson is a powerful and widely used open source
continuous integration server providing
development teams with a reliable way to monitor
changes in source control and trigger a variety of
builds.
(The Hudson Book)
21 © 2012 Creative Arts & Technologies

22. Hudson | Downloads
22 © 2012 Creative Arts & Technologies

23. Hudson | Commits
23 © 2012 Creative Arts & Technologies

24. Hudson | Job Coordination
24 © 2012 Creative Arts & Technologies

25. Hudson | Job Coordination Triple-E size
25 © 2012 Creative Arts & Technologies

26. Hudson | Promoted Builds
26 © 2012 Creative Arts & Technologies

27. Hudson
DEMO

28. The Price of Continuous Integration
28 © 2012 Creative Arts & Technologies

29. Let„s talk
Q&A

30. Links
Kokki
https://github.com/samuel/kokki
Multiconf
https://github.com/lhupfeldt/multiconf
PyDev
http://www.pydev.org

31. Links (2)
Eclipse – Hudson
http://www.eclipse.org/hudson/
Apache Maven
http://www.apache.org/maven/

32. Thank you
32 © 2012 Creative Arts & Technologies Images © Maersk Line