Running stateful services in containers - ContainerDays Boston 2016

1
community.emccode.com
RUNNING STATEFUL SERVICES IN
CONTAINERS
JONAS ROSLAND, EMC {code}
DEVELOPER ADVOCATE & COMMUNITY MANAGER

2
• How are Container Platforms managed?
• Handling stateless apps and stateful services
• Everything running in containers
• Making the platforms understand data persistence
AGENDA

3
• Clustered servers
• Manual deployments
• Redundancy, not necessarily high availability
BACK IN THE OLD DAYS

4
• Infrastructure as a Service
• Deploy virtual machines
• Manual/half-automated way of deploying apps
• Almost efficient
THEN SOME TIME AGO

5
• Collection of compute resources
• Spread out horizontally
• Brings scale to your deployments
NOW – CONTAINER PLATFORMS

6
Standard definitions

7
APPLICATIONS RUN IN CONTAINERS
Code
Code and
requirements
Container

8
• Manages all physical/virtual
resources
• Deploys and schedules apps
• Handles hardware failures
RESOURCE MANAGERS AND SCHEDULERS

9
SCHEDULING

10
PAAS SITS ON TOP OF SCHEDULERS

11
• Enables apps and infra
to automatically find
parts of each other
• Keeps track of how to
connect and use the
application services
SERVICE DISCOVERY

12
SERVICE DISCOVERY

13
You don’t have to
rewrite your apps!

14
• Storing data (state) is a critical component of any
application
• Where they store this state defines their class
– Connected database
– In memory
– Local disk
APPLICATION STATE DIFFERENCES

15
• Store no critical data locally
• Can be scaled as needed
• Recovers quickly
STATELESS APPLICATIONS

16
• Services that store state
• Have usually been treated as HA apps
• Can be scale-out or scale-up
STATEFUL SERVICES

17
FROM oraclelinux:latest
ENV PACKAGE_URL https://repo.mysql.com/yum/mysql-5.7-community/docker/x86_64/mysql-community-server-minimal-5.7.12-
1.el7.x86_64.rpm
RUN rpmkeys --import http://repo.mysql.com/RPM-GPG-KEY-mysql && yum install -y $PACKAGE_URL && yum install -y
libpwquality && rm -rf /var/cache/yum/*
RUN mkdir /docker-entrypoint-initdb.d
VOLUME /var/lib/mysql
COPY docker-entrypoint.sh /entrypoint.sh
ENTRYPOINT ["/entrypoint.sh"]
EXPOSE 3306 33060
CMD ["mysqld"]
MYSQL IN A CONTAINER

18
APPLICATIONS BUILT FROM SERVICES
Front End or Non-Persistent
Data Services (Persistent)
Scale-Up
Scale-Out
Cassandra
Postgres
Redis
CouchDB
Elastic Search
Hadoop
MariaDB
Mysql
Nginx
HAProxy
MongoDB
RabbitMQ
Tomcat
Memcached
ScaleIO ECS
ApacheRails
Language Specific HTTP

19
• No!
– Without proper storage mapped, the service will lose data
– Data doesn’t travel with the service if it’s stored on local
disk
• Yes!
– Automatically mapping modern storage backends delivered
by EMC, AWS, GCE, OpenStack and others
enables your data to be stored safely
STATEFUL SERVICES IN CONTAINERS?

21
• Have been mostly focused on stateless apps
• Working hard on making stateful services part of
their inventory
• So how do you handle both types?
CONTAINER PLATFORMS

22
• Data is stored outside the platform
EXAMPLE 1

23
• Data is stored on the same platform
EXAMPLE 2

24
Virtual Machine
PERSISTENCE AND P3
Platform 2 Platform 3
High Availability
Live Migration
Highly Available
Container Platform
Lifecycle Management
Container Platform
Lifecycle Management

26
Making the platform
understand storage

27
• When a container starts, we can map storage to it
• For apps such as databases this is a necessity
• When a container stops, the storage is unmounted
and can be reused by another container
HOW DOES STORAGE IN CONTAINERS WORK?

28
• Local storage locks the container’s data on one
server
• Using non-local storage gives us the possibility to
move containers across servers
• Having that possibility is crucial for HA environments
WHY NOT USE LOCAL STORAGE?

29
LET’S START WITH THE BASICS
GCE
?
AWSEMC OpenStack

30
SAY HELLO TO MY LITTLE FRIEND – REX-RAY

31
NOW WE’RE GETTING SOMEWHERE
GCEAWSEMC OpenStack

32
AND NOW IT’S GETTING INTERESTING
GCEAWSEMC OpenStack
Mesos Kubernetes

33
• Gives you the possibility to use any storage platform,
and even multiple platforms at the same time
• Always in sync with Docker’s development cycle
• Integrated with Docker, Mesos and Kubernetes
REX-RAY BENEFITS

Running stateful services in containers - ContainerDays Boston 2016

Running stateful services in containers - ContainerDays Boston 2016

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Destacado

Destacado (20)

Similar a Running stateful services in containers - ContainerDays Boston 2016

Similar a Running stateful services in containers - ContainerDays Boston 2016 (20)

Más de Jonas Rosland

Más de Jonas Rosland (15)

Último

Último (20)

Running stateful services in containers - ContainerDays Boston 2016

Notas del editor