Dopo la diffusione del Cloud Computing e di Docker, è ancora preferibile adottare i classici SaaS di Continuous Integration rispetto ad un sistema Jenkins in cloud? L'intervento ha l’obiettivo di mostrare un caso d'uso applicato in Ideato di migrazione da un SaaS quale Travis ad un sistema Jenkins in cloud, sfruttando funzionalità di on demand tramite il cloud di Amazon Web Services e di containerizzazione tramite Docker. Tenendo in considerazione gli aspetti tecnici legati all’implementazione e quelli che potrebbero impattare sul fronte economico come la mancanza di automatizzazione e i tempi di setup, verranno mostrati pregi e difetti di questo sistema e come può essere applicato ad una serie di progetti. Infine verranno elencati una serie di prodotti recentemente rilasciati e in grado di far evolvere ulteriormente l'attuale sistema.

1. Continuous Integration
SaaS vs Jenkins in cloud

2. GLUTEN
FREE
Alessandro Mazzoli
alendmazz
am@ideato.it
Who am I?
sysadmin@ideato
AWS solution architect

3. Why I should prefer
on premise Jenkins
vs SaaS
like Travis or CircleCI?

4. What is Jenkins?

5. Jenkins is a famous
cross-platform,
continuous integration
and continuous delivery
application

6. cross platform
support SCM tools
released under MIT license
Java based (war file)

7. job execution monitoring
reports, notifications
rich of plugins(Docker,
Github, Slack, Build Pipeline)
hooks, triggers, conditionals

9. Let’s talk about $$$
170 US$
130 US$
Travis Startup AWS c4.xlarge
costs estimated on demand c4.xlarge up for 24h/day

10. I have also to
configure and
maintain Jenkins…

13. switch on/off
every day???!!

14. Waste
Boring
Stressful

17. AWS CLI + CRONJOBS

18. !/bin/bash
EC2_ID=i-abcdefgh
EIP=52.*.*.*.
IAM=ideato_jenkins
aws ec2 start-instances --instance-ids ${EC2_ID}
profile ${IAM}
aws ec2 associate-address --instance-id ${EC2_ID}
--public-ip ${EIP} --profile ${IAM}
exit 0
jenkins_on.sh

19. !/bin/bash
EC2_ID=i-abcdefgh
IAM=ideato_jenkins
aws ec2 stop-instances --instance-ids ${EC2_ID}
—profile ${IAM}
exit 0
jenkins_off.sh

20. Let’s talk again about $$$
54 US$
130 US$
Travis Startup AWS c4.xlarge
costs estimated on demand c4.xlarge up for 8h/day

21. Save more
money?

22. Put your Jenkins on
Reserved Instances

23. Reserved Instances
capacity
reservation
for one or
three years
inside an AZ
help AWS on
capacity
planning
hourly billing
rate lower

24. Reserved Instances
switch AZ within
the same region
Change the
instance size
within the same
instance type
not just
EC2
billing
mechanism

25. Reserved Instances
reservation
cannot be
refundable
applied to a
single
instance types
restricted
inside a region

26. Reserved Instances
all upfront 3y save up
70%
all upfront 1y save up
30%

27. Let’s talk again about $$$
34 US$
130 US$
Travis Startup AWS c4.xlarge
costs estimated on reserved 1y upfront
c4.xlarge up for 8h/day

28. Ok but….

29. different stacks?!
• OS (Debian vs RedHat)
• PHP(5.x), Java, Python
• Elasticsearch(0.9->1.7)
• Mongo
• MySQL,PostgreSQL

30. On Travis I just
have to edit
.travis.yaml

33. ~= Python virtualenv

34. not suited for CI
system
one virtualenv active
at once

35. Containers history
1979 - chroot
unix syscall to change
root directory
of a process to a new location
only visible by that process

36. Containers history
2007 - cgroups
used for limiting, isolating and
accounting
defining CPU, RAM, I/O

37. Containers history
2008 - LXC
first implementation of Linux
containers with several features:
cgroups, namespace, CAP,
API bindings on Ruby,Python..

38. Containers history
2013 - Docker

40. it’s a
container
technology

41. was LXC

42. isolation

43. encapsulation

44. portability

45. was LXC
now runc
(Open Container Initiative)

46. difference
between VM &
Docker??

47. Containers vs VMs

50. AUFS
Advanced Unification FileSystem
Layered FS
Copy on Write
enable Docker Image layers

51. Docker Images
read only layer
used to be containers
composed by layers

53. Our Docker Images

54. Our Docker Images
FROM ubuntu:trusty
RUN apt-get install -yq
software-properties-common
python-software-properties
git
vim
wget
curl

55. Our Docker Images

56. Our Docker Images
FROM ideato/trusty
ENV DEBIAN_FRONTEND noninteractive
RUN add-apt-repository -y ppa:ondrej/php5
RUN apt-get install -yq --no-install-recommends
php5
php5-cli
php5-common
php5-dev
php5-gd
php5-curl
php5-mcrypt
libapache2-mod-php5

57. Our Docker Images

58. Our Docker Images
FROM ideato/trusty_php:5.5
RUN apt-get install -yq mysql-server-5.5
RUN wget https://phar.phpunit.de/
phpunit.phar
RUN chmod +x phpunit.phar
RUN mv phpunit.phar /usr/local/bin/phpunit

59. Workflow…
projects should
have their
Dockerfile

60. Workflow..
these Dockerfiles
should be built on
top of CI Images

61. Our Docker Images

62. Example Project
FROM ideato/trusty_php_CI:5.5
ENV DB default
RUN apt-get install -yq
npm
openjdk-7-jre
openjdk-7-jdk
nodejs
RUN wget https://download.elastic.co/elasticsearch/
elasticsearch/elasticsearch-1.7.3.deb
RUN dpkg -i elasticsearch-1.7.3.deb
ADD bin/run_tests /
ENTRYPOINT [“./bin/run_tests”]

63. Example Project
#!/bin/bash
cd /exampleproj/workspace
service mysql start
service elasticsearch start
bin/idx build

64. Our Jenkins
web hook

65. Our Jenkins
web hook
docker build -q -t
ideato:exampleproj
-f Dockerfile .

66. Our Jenkins
web hook
docker build -q -t
ideato:exampleproj -
f Dockerfile .
docker run --rm=true
-v $WORKSPACE:/example_project
-t ideato:exampleproj

67. Our Jenkins
web hook
docker build -q -t
ideato:exampleproj -
f Dockerfile .
docker run --rm=true
-v $WORKSPACE:/example_project
-t ideato:exampleproj
channel
notification

68. Resuming….
1 day for Jenkins setup
~ 280$
(one time cost)
+
AWS c4.xlarge 34$ x 12 ~ 600$
vs
TravisCI Startup Plan 130€ x 12 = 1560$

69. oh wait…
~ 1/3 build time
than Travis

70. in the next few
months…

72. built in support for
delivery pipelines

73. pipeline as code

74. Jenkinsfile!!!

75. better UX on
pipeline

77. finally batteries
included

79. fully backward
compatible

80. try it !
docker pull jenkinsci/
jenkins:2.0-alpha-3

81. what else?

82. on dev we are using
OSX + Vagrant + Ansible
and no Docker atm

83. why?

84. Add more complexity
to FE devs

85. customers won’t pay
to migrate old projects

86. no native support
until now…

87. https://blog.docker.com/2016/03/
docker-for-mac-windows-beta/

88. no more VirtualBox,
native hypervisor support
Mac -> xhyve
Windows -> HyperV

89. on Mac,
Docker Engine will run
inside a Alpine Linux
on top of xhyve

90. native
Windows/Mac app

91. on OSX….

92. volume mounting for
code/data
with auto update
on file changes
(GIT, Sublime,PhpStorm)

93. tools integrated inside Docker
Toolbox
Docker Engine, Docker Compose,
Kitematic

94. Links
JenkinsCI
Jenkins 2.0
AWS Reserved Instances
Docker
Docker on OSX & Windows

95. Thanks!

96. Questions ??