Home

/

Beyond the Fractional CTO

/

The Top 10 KPIs: Definitions & How to Measure

The Top 10 KPIs: Definitions & How to Measure

Appendix B
Appendix
3
min read

The scorecard in Chapter 12 gives you the ten numbers on one page. This appendix tells you how each one is built, so anyone running your delivery can compute it the same way twice. Four of the ten come straight from the DORA four key metrics (DORA, 2024): lead time for changes, change-failure rate, time to restore, and (by extension) the delivery rhythm those metrics assume. The rest are the measures a non-technical founder can read without learning to run a sprint.

A note on "what good looks like." Where a public benchmark exists and is sourced, the table names it. Where one doesn't, the column gives you a direction of travel rather than a borrowed number, because a made-up target is worse than an honest one. The point of a KPI isn't to hit somebody else's figure. It's to make a hidden thing visible and give one person the job of moving it.

The ten, at a glance

#KPIAccountability it serves
1Lead time for changesSoftware delivery
2Delivery predictabilitySoftware delivery
3Cycle time per taskTeam performance
4Bus-factor / key-person concentrationTeam performance
5Change-failure rateOperational reliability
6Time to restore (MTTR)Operational reliability
7Defect escape rateTechnical quality
8Rework ratioTechnical quality
9% of work tied to a business outcomeRoadmap & business alignment
10Roadmap commitment accuracyRoadmap & business alignment

Lead time for changes

What it isThe clock from "a change is started" to "that change is live in front of users." A DORA key metric (DORA, 2024).
How to measureTimestamp when work begins on a change and when it reaches production. Take the median over a rolling window, not the average — one slow item shouldn't move the headline.
What good looks likeShort and steady. Trending down over a quarter matters more than any single figure. If lead time is measured in weeks, your delivery has a queue you can't see.
ServesSoftware delivery.

Delivery predictability

What it isHow closely what you said you'd ship matches what you actually shipped, over a defined window. The honesty check on the cadence.
How to measureAt the start of each cycle, record what was committed. At the end, record what shipped. Predictability = delivered ÷ committed, tracked over time. Count only work that met its definition of done.
What good looks likeHigh and stable, without padding the commitment to game it. A team that promises little and delivers it isn't predictable. It's quiet.
ServesSoftware delivery.

Cycle time per task

What it isHow long one task takes from "picked up" to "shipped." Lead time looks at the whole change; this looks at the unit of delivery, the task.
How to measurePer task, log the time from in-progress to done. Report the median and the spread. A tight spread tells you the work is genuinely task-shaped; a wide one says some "tasks" are really projects in disguise.
What good looks likeConsistent, with few outliers. When most tasks land inside a narrow band, capacity becomes something you can forecast instead of guess.
ServesTeam performance.
the-title-trap
what-a-cto-is-actually-accountable-for
software-delivery
team-performance
operational-reliability
technical-quality
roadmap-business-alignment
the-spec-graveyard
task-shaped-work
running-the-cadence
visibility-accountability
the-scorecard-the-top-10-kpis
technical-quality-is-the-codebase-getting-cheaper-or-more-expensive-to-change
build-hire-or-subscribe
conclusion-reliable-execution-delivered
the-artifact-pack
the-top-10-kpis-definitions-how-to-measure
bus-factor-key-person-concentration
fractional-cto-sources-further-reading
the-cost-maths-chapter-13

Download the full PDF for free?

Oops! Something went wrong while submitting the form.
Related Chapters