This document discusses managing chaos in complex systems like pipelines and plumbing. It suggests embracing failures and decentralization. Key concepts mentioned include feedback loops, self-organization, microservices, serverless architecture, blockchain, and chaos engineering. The document advocates for simplifying interaction between components rather than the components themselves. It also promotes open policy, observability, and dynamic policy definition for distributed systems.

1. When Your Pipelines
Are a Mess
Managing Chaos in Your
Plumbing
Ant(on) Weiss, Otomato
@antweiss
http://otomato.link

2. Edward Norton Lorenz

7. FEEDBACK LOOPS
FLOW

8. Russell Ackoff
Donella Meadows
Peter Senge
"English does not contain a
suitable word for 'system of
problems.' Therefore, I have
had to coin one. I choose to
call such a system a mess"

10. Adaptivity
Self-Organization
Decentralization
Scale-Free
Chaosology

11. Microservices!

12. 3 very simple
services
having a little
chat

14. SERVERLESS

15. Fog Computing

16. BLOCKCHAIN

17. Embrace the inevitability of
failures
http://principlesofchaos.org/
Chaos Engineering

18. 1. We can not simplify a system by simplifying its parts
2. The only way to simplify a system - by simplifying the
interaction of its components.

19. Interaction
Common
Language
Protocol

20. DSIP
Distributed System
Integration Protocols:
★ Observability
★ Policy
★ Events

22. Open Policy Agent

25. Secure Production Identity Framework for Everyone

26. But what about delivery?
●
● Decentralized
● Event-driven
● Observable (transparent)
● Dynamic Policy Definition

27. The Evolution of Trust
Local Centralized Distributed

28. ○ Decentralized
○ Leaderless
○ Asynch Communication
○ Transparency of Information
A True DevOps Org

30. Burnout occurs
when you are
expected
to control things that can not
be controlled.

31. THANK YOU!
@antweiss
http://otomato.link
https://medium.com/@antweiss