This document discusses Netflix's redesign and how they used data-driven experimentation to improve customer engagement and retention. Netflix tested a redesigned interface and found it increased engagement by 30 basis points and retention by 20 basis points, equating to 160,000 additional members. The key lessons are that data should be the focus, experiments should go through exploration and refinement phases, and constant testing is important for continuous improvement.

1. Leads by Office
Making
Data
Driven
Decisions
Marius
Kremeyer
Op6mizely
Europe

3. Netflix Redesign

4.
Boo!
Hiss!
Shock!
Horror!

5. The
customer
is
always
right?
Engagement
+
30
basis
points
Reten6on
+
20
basis
points
=
160,000
members
Lesson
Learned?
“Just
hold
true
to
the
philosophy
that
the
data
is
what
ma+ers”
Bryan
Gumm
–
Manager
of
Experimenta6on
-­‐
NeRlix

6. GeWng
started?

7. Digging
deeper

8.
Keep
tes6ng
“If
you
don’t
measure
it,
you
won’t
improve
it”
Henry
Ford

9. Key
learnings
1.
The
data
is
what
ma_ers
2.
Explore
and
then
Refine
3.
Always
be
tes6ng!

10. Thank
You!