Skeptics in the Church of Data Getting Evangelical

Skeptics in the Church of Data Getting Evangelical
AaronAldrich–CageData/VictorOps
@CrayZeigh#Galaxz17

© 2016 All Rights Reserved CONFIDENTIAL@CrayZeigh 2
Aaron Aldrich
@CrayZeigh
@cagedata
@victorops

incidents happen
and they suck

we monitor
systems religiously

The Trinity of System Monitoring
• Thou shalt
monitor CPU
Usage
• Thou shalt
track processes
•Thou shalt
monitor disk
space
•Thou shalt
monitor I/Os
• Thou shalt
monitor
memory
availability
• Thou shalt
track activity
Process Memory Disk

sacraments
baptism
confession
repentance

100% uptime

monitoring
resources makes
sense when
tracking physical
system health

The New Data Center

if you’re deciding
which alarms are
important, you have
too many

start monitoring
business metrics

revenue
courtesey Leon Fayer of OmniTI (@papa_fire)

user latency

database performance

decline rate (%)

how can I be a superhero?

“She doesn’t care whether or
not [the data center is literally
on fire] … just as long as his
ship’s coming in…”
-Cake, Italian Leather Sofa
(lightly interpreted)

have a chat with
your business

Spoiler Alert
90% of the
time you’ll
be listening

What happens on a normal day?
What happens on a good day?
What happens on a bad day?

If you could have insight
into one piece of the
organization, what would
it be?

listen to your business

context is crucial

new allies become evangelists

what about marketing?

(https://blogs.adobe.com/digitalmarketing/wp-content/uploads/2015/10/laxalt-fig1.jpg)

The Chasm
(Moore – Crossing the Chasm 1991)

change conducted poorly will
break your organization

strict change enforcement
creates unrest

…harder than you think
…takes longer than you expect
…self-initiated
change is…

1.Flow
2.Feedback
3.Continuous
Experimentation &
Learning
The Three Ways

-enables continuous improvement
Amplify Feedback Loops
You Them

retrospectives

invite the whole
business

Reframe the goal:
we don’t want to find out what
should have happened, we want to
learn how to improve.

blame creates subject
matter experts in
information
suppression

ritual is important

“Before we begin, I want to remind
everyone that postmortems are
blameless. We’re not here to discuss
what should have or could have
happened because we’re here to
learn and gain new information for
the future.”

• VictorOps Blameless Postmortem Guide  
http://bit.ly/2nBAvq2 
(https://victorops.com/wp-content/uploads/2014/09/Blameless-Post-Mortems.pdf)
• Chef Postmortem Template - http://bit.ly/2noY4S1 
(https://gist.github.com/btm/7cb421f5fe7d1003083a)
• Etsy’s Debriefing Facilitation Guide  
http://etsy.me/2iVP7Bj 
(https://extfiles.etsy.com/DebriefingFacilitationGuide.pdf)
Retrospective Resources

stop thinking about your
systems’ health and start
thinking about your
business’s health
Be Skeptical of your Traditions

partner with data-driven
departments in your org
to proselytize the benefits
of business monitoring
Make new evangelists

build safe environments,
amplify feedback and
foster learning
Safely Reform

Change the
world

Change the
world(Or at least your monitoring)

Thanks!
@CrayZeigh
Aaron Aldrich
http://cageit.us/GalaxZ17
SlideShare:

Skeptics in the Church of Data Getting Evangelical

Recomendados

Recomendados

Más contenido relacionado

Más de Aaron Aldrich

Más de Aaron Aldrich (9)

Último

Último (20)

Skeptics in the Church of Data Getting Evangelical