Section Measurement
What measurement does to what it measures
Proxies, baselines, thresholds, retention, and what happens when the measure becomes the target.
For a separate operational view of time, ownership and team activity, see Monitask's practical guide.
Everything else on this site depends on the seven articles in this section, because both markets it covers rest on the same act: choosing something countable to stand in for something that matters.
These pieces are about that choice. What a proxy is and how far it sits from its target. Why a number is meaningless without a baseline. What a threshold costs in both directions. How long data is kept, and what keeping it buys and costs. Who is shown the dashboard, and how that changes what the dashboard does to the people in it. What no tool in either market can measure. And what happens once a measure is used to judge, which is the failure that has a name.
Nothing here recommends a product. The sections that do are downstream of this one, and a selection read without it tends to end in a purchase that satisfies a metric.
Published
- 01
Every monitor reports a proxy, and the proxy is not the thing
The number is real, the measurement is honest, and the state you cared about was never observed at all.
Read - 02
A number means nothing until you know what normal was
Without a baseline every reading is either alarming or reassuring depending entirely on who is looking at it.
Read - 03
Signal, noise, and what a threshold really costs
A threshold is a classifier that is wrong in two directions, and when the event is rare an accurate detector still cries wolf.
Read
Everything in this section
- 6 min readEvery monitor reports a proxy, and the proxy is not the thing
- 6 min readA number means nothing until you know what normal was
- 6 min readSignal, noise, and what a threshold really costs
- 6 min readRetention: what you keep, for how long, and what that costs
- 6 min readWho sees the dashboard changes what the dashboard does
- 6 min readWhat no monitoring tool can measure, in either market
- 7 min readWhen the measure becomes the target
Further context
Start from the class of problem, not the list of tools
Every selection here names the situation first and the criteria second. Product names come last, and each one carries the line describing what it costs you.