SpringOne Platform 2019
Title: K8s at Scale in the Enterprise: Self-Service Through the View of Personas
Speakers: Ryan Jones, Product Lead, Pivotal; Gabrielle Bufrem, Manager, Product Management, Pivotal
Youtube: https://youtu.be/gtnX6bM8vV4
15. Feel Free to Walk Out If:
● If you are a small company (few teams) and don’t expect to grow
● 100% of your k8s deployments are managed by a third party (ex. AKS)
● 100% of your deployments are using an abstraction layer (ex. Pivotal
Application Service)
@gbufremsays
16. If You’re a Large Enterprise or Expect to Scale:
● Many are hybrid cloud (on-prem and public clouds)
● Dozens, hundreds, or thousands of k8s clusters
● 100s of teams
● 1000s of Devs
● 10,000s of containers
17. Kubernetes: The Silver bullet
● Brings operational efficiency to all workloads - greenfield, legacy (brownfield),
data services, etc
● Includes self healing properties to manage itself
● Ability to outsource a lot of the work to the large open source community
● Decrease or provide zero downtime of all applications/services
● Provides a consistent deployment strategy across the organization
● Abstract away the IAAS for teams and operations
● Simplify dev tools by giving direct access to Kubernetes and the tools built for it
@gbufremsays
18. It’s Not, so How do You Manage This at Scale?!
● I’m sorry to say, k8s is not a silver bullet and it calls for a different structure
● Most are keeping the same org structures and expecting them to handle the rise
in k8s
● Various options and steps to scale
@gbufremsays
20. Introducing More Members of The Team
People within Alana's group
manage platform services for
the application team.
Alana
@gbufremsays
21. Introducing More Members of The Team
People within Cody's group are
responsible for developing
applications and products and are
directly tied to the Line of business.
Cody
@gbufremsays
22. Day 0 - Testing of The Kubernetes Platform
Create Workloads
& Manage Legacy
Workloads
@gbufremsays
23. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
@gbufremsays
24. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
25. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
26. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
27. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
28. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
29. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
30. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
31. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
32. And More Members of the Team!
Naomi
People within Naomi's group are
responsible for containerizing and
deploying workloads
@gbufremsays
33. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
34. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
35. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
36. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
NaomiCharlie
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
37. Last Member of The Team!
Charlie
People within Charlie's group are
responsible for deploying and
managing Kubernetes clusters
@gbufremsays
38. Day 2 - Production @ Scale
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
NaomiCharlie
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
39. Day 2 - Production @ Scale
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Naomi
Charlie
Platform
Management
(IAAS, VMs, k8s)
Deploy Workloads
to Namespaces
Containerize
Workloads
Automation
@gbufremsays
40. Day 2 - Production @ Scale - Winnie-the-Pooh Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Charlie
Platform
Management
(IAAS, VMs, k8s)
Containerize
Workloads
Deploy Workloads
to Namespaces
Automation
@gbufremsays
41. Day 2 - Production @ Scale - Winnie-the-Pooh Option
Alana
Charlie
Cody
Charlie Charlie
Cody Cody Cody Cody Cody
Line of Business Line of Business
@gbufremsays
42. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
Containerize
Workloads
Deploy Workloads
to Namespaces
Automation
@gbufremsays
Charlie
43. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
Containerize and
Deploy Workloads
Automation
@gbufremsays
44. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays
45. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
Deploy & Manage
K8s Clusters
Containerize and
Deploy Workloads
Automation
@gbufremsays
46. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
Containerize and
Deploy Workloads
Deploy &
Manage
K8s
Clusters
Automation & Abstraction
@gbufremsays
48. AUTOMATION TEAMS
● Automate as much as
possible
● Add abstraction layers to
manage K8s
● K8s is much harder to
manage than people
expect
● You need self service &
org structure changes to
scale
● Shared Kubernetes
expertise: the division,
specialization and
distribution of expertise;
reducing overhead -
“move it to the right”
Key Takeaways
@gbufremsays