This document discusses how to define key performance indicators (KPIs) for platforms. It begins by explaining why platform KPIs are important, such as improving decision making and learning unseen insights. Common pitfalls like only using qualitative data or vanity metrics are outlined. The author recommends starting by measuring your value proposition and scaling instrumentation over time. Examples of platform KPIs provided include adoption metrics, use case coverage, extensibility, technical performance, and workflow metrics. Overall, the document provides guidance on strategically defining KPIs to measure a platform's performance.
7. Agenda
● Why should you care about defining Platform KPIs?
● Common pitfalls
● How to go about it?
● Some examples
8. A few concepts first
1. What is a Platform
https://martinfowler.com/articles/talk-about-platforms.html
“A digital platform is a foundation of self-service
APIs, tools, services, knowledge and support which
are arranged as a compelling internal product.
Autonomous delivery teams can make use of the
platform to deliver product features at a higher
pace, with reduced co-ordination.”
Evan Botcher, 2018
10. KPIs are your most important metrics in moving
your product forward. All KPIs are metrics. Not
every metric is a KPI.
A few concepts first
3. Metric vs KPIs
34. Some examples
1. Adoption metrics
a. Which customers are using
your product.
b. Not relevant if customers do
not have a choice.
c. Usually important when you
are launching a product.
35. 2. Use case coverage/variations
metrics
a. For how many different use cases
(of all of them) are customers
choosing your product.
b. How many variations of the same
thing are customers doing with
your product.
c. Important to measure penetration
across your customers as the
product matures.
Some examples
36. 3. Extensibility metrics
a. Usually a platform product
has to support extensibility if
you don’t want to become a
bottleneck.
b. How much are your users
extending your product?
c. Sometimes is even good to see
the cross sharing of
extensions between
customers.
Some examples
37. 4. Technical performance metrics
a. Uptime, #incidents, response
time...
b. Some platform products,
especially the more you go to
the core, the main value is for
them to “just” work flawlessly
Some examples
38. 5. Workflow metrics
a. Time to do X
b. If you struggle with it, flip it and
count volumes rather than round
time.
i. Be weary of the trap,
sometimes you save people
time not to do more of the
same, but to have time to do
something else.
Some examples