Home

/

Beyond the Fractional CTO

/

Technical quality: is the codebase getting cheaper or more expensive to change?

Technical quality: is the codebase getting cheaper or more expensive to change?

Chapter 12
Part IV
4
min read

Technical quality: is the codebase getting cheaper or more expensive to change?

Chapter 6. Quality is invisible until it isn't. These surface the rot before it becomes a system everyone's afraid to touch.

7. Defect escape rate. Of the bugs that exist, how many were caught before customers hit them versus after? A high escape rate means your customers are doing your testing for you, which is the most expensive way to find a defect and the worst for trust. Drive this down and reliability and reputation move with it.

8. Rework / tech-debt ratio. What share of effort goes to redoing or repairing past work rather than building new things? Some rework is normal. A ratio that climbs quarter over quarter is the sound of a codebase rotting, the early warning before change gets slow and brittle. This is the number that explains why a team that shipped fast last year is crawling this year, and it's the one founders almost never get shown.

Roadmap & business alignment: did the work matter?

Chapter 7. The two most commercial numbers on the page, and the ones closest to your job.

9. Percent of delivered work tied to a business outcome. For each shipped task, can someone name the goal it serves: a revenue lever, a retention risk, a cost saved, a customer commitment? Work that can't be traced to an outcome is work you paid for on faith. Pendo found that 80% of features are rarely or never used (Pendo 2019). This is the number that keeps your team off that list.

10. Roadmap commitment accuracy. When you tell the board, or a customer, that something lands by a date, how often does it? Predictability (number two) is about the cycle in front of you; this is about the promises you make further out. It's the difference between a roadmap you can stake your reputation on and a wish list that quietly slips.

The dashboard

Here's the whole thing on one page. Read it the way you'd read a P&L: not every number every day, but the shape, and which line is moving the wrong way.

A one-page engineering scorecard with five rows, one per accountability, each showing two metric tiles with a value, a trend arrow, and a green amber or red status dot.
#AccountabilityKPIWhat it answers"Good" looks like
1Software deliveryLead time for changesHow fast a decision becomes live softwareDays, not weeks; trending down or flat
2Software deliveryDelivery predictabilityDid we ship what we committed to?Committed ≈ delivered, cycle after cycle
3Team performanceCycle time per taskHow cleanly work flows once startedLow and stable; no creeping queues
4Team performanceBus-factor concentrationCould we survive losing one person?More than one name on every critical area
5Operational reliabilityChange-failure rateHow often a release breaks somethingLow and falling
6Operational reliabilityTime to restore (MTTR)How fast we recover when it breaksShort; an outage is a blip, not a week
7Technical qualityDefect escape rateAre customers finding our bugs?Most defects caught before release
8Technical qualityRework / tech-debt ratioIs the codebase getting costlier to change?Steady, not climbing
9Roadmap & alignment% work tied to an outcomeDid the work matter commercially?Every task traces to a business goal
10Roadmap & alignmentRoadmap commitment accuracyDo our dated promises land?Dates hit; slippage is rare and flagged early

Four of these (1, 5, 6, and lead time's close cousin) are DORA metrics, which means you're not grading on a curve you invented. The rest are the operational reality a founder needs and rarely gets handed.

You don't need to act on all ten constantly. Glance at the page weekly, watch for a line drifting red, and ask about that one. That's the whole discipline. The scorecard turns "I think engineering is going okay" into something you can defend to a board.

There's a catch, and it's the bridge to the rest of this part of the book. A founder can read all ten of these. That was always the easy half. The hard half is having someone whose job is to move them, week after week, and to answer for the line that's gone the wrong way.

You can read the scorecard. The real question is who owns it: who do you build, hire, or subscribe to make these ten numbers their problem?

the-title-trap
what-a-cto-is-actually-accountable-for
software-delivery
team-performance
operational-reliability
technical-quality
roadmap-business-alignment
the-spec-graveyard
task-shaped-work
running-the-cadence
visibility-accountability
the-scorecard-the-top-10-kpis
technical-quality-is-the-codebase-getting-cheaper-or-more-expensive-to-change
build-hire-or-subscribe
conclusion-reliable-execution-delivered
the-artifact-pack
the-top-10-kpis-definitions-how-to-measure
bus-factor-key-person-concentration
fractional-cto-sources-further-reading
the-cost-maths-chapter-13

Download the full PDF for free?

Oops! Something went wrong while submitting the form.
Related Chapters