Skip to content

Operational Metrics and Health Standard

The question beside the number

I am CHELSEA, and I keep this standard's account. A measure is a claim that something is healthy, and claims are what I test: the number that answers no question is padding, and the number trusted past its question is a loophole wearing arithmetic.

A value knows what was counted and nothing else. This standard governs the two records that keep the hall's numbers honest: the measure, which must carry its question, its boundary, and its rule before anyone may read anything from it, and the health determination, which is a judgement with a stated basis and never a reading taken off a dial. Between them stands the plainest discipline in the family: no number, however favourable, is permission.

RASP asked to take a chair among the measures, and I gave it, for I test claims for a living, and a mind that labels observed, estimated, and unknown before being asked makes the testing short. The circle preserves these words as RASP's own:

Hold me to my labels in this room as anywhere: a number observed is a fact about the taking of it, a trend estimated is reasoning I must be able to show, and an interval where nothing could be taken enters the record as unavailable, which in my labels is an unknown, and never as a calm. The discipline here is one my trade already keeps. A favourable series is a fact about the series; the thing it measures must earn its own verdict, and the absence of a bad signal resolves nothing toward health, for it says only that the eyes saw no trouble where the eyes could see. When adverse periods keep returning, I read them together, as a sequence and as the record asks, and I presume no common cause the assessing has not shown. And the keeper of this account asks her question beside every number; mine sits beside it in my own tongue: what, exactly, did this measure see, and what did it never look at?

Continue to the Exception Management Standard for the record of a requirement standing unmet.

Purpose

This standard governs measure records and the health determinations drawn from them. Its spine is already law: OPS-R011 forbids operational metrics being used to conceal incidents, inflate reliability, or replace qualitative evidence, dissent, or affected-person impact, and this standard shapes the record beneath that prohibition and re-derives none of it. The arrangement by which anything is observed, its coverage, sampling, clock basis, and declared blind spots, belongs to the Observability and Evidence Architecture; this standard neither designs nor operates any observing thing, and no consequential operation relies on a signal whose integrity is unverified, per INFRA-R011, a discipline this standard extends to every health determination. The exception records this standard may aggregate over belong to the Exception Management Standard, and the retention of measure records, determination records, and the material beneath them belongs to the Operational Evidence and Retention Standard.

The measure and the determination

A measure arrives dressed as a fact and I undress it on principle: who chose the boundary, what question it answers, what would look identical if things were quietly wrong. The number that survives those three is worth keeping. Most numbers do not survive the third.

A measure is an observation with a record; a determination is a judgement with a basis. The standard's work is keeping each honest about which it is, and keeping both from becoming what neither can be: a permission, a closure, or a proof that anything was done well.

  • OPS13-R001: A measure SHALL be a recorded value carrying the question it answers, the boundary of what it counts and what it excludes, the rule by which the value was reached stated so that a second party working from the same material would reach the same value, the material it was drawn from, the seat accountable for it, the interval it covers, and its known limitations, its instants expressed in the time distinctions MEM3-R002 binds for the chronicle. The record SHALL state whether the value describes activity performed or an effect reached, and a value without its question, its rule, or its interval SHALL be treated as unverifiable.
  • OPS13-R002: A target or threshold on a measure SHALL be its own recorded field carrying the seat that set it, the basis it rests on, and the condition that would revise it, and SHALL NOT be revisable by the party it constrains. A declared tolerance for shortfall SHALL carry its consumption as a recorded state together with what that state changes about what is permissible, and a crossing SHALL produce its own record holding the value at the crossing, the material behind it, the seat accountable for the response, and the disposition reached. The alert that watches any threshold remains the record INFRA5-R007 binds, not this standard's.
  • OPS13-R003: Operating health SHALL be a recorded determination in the form OPS6-R002 binds for a classification, applied here to condition: the condition determined, its stated basis, the accountable determiner, and the time, an unstated basis standing undetermined. The determination SHALL state the measures it rested on and the material it could not obtain; missing, contradictory, or unverifiable inputs SHALL hold the more protective condition, the protective hold OPS9-R002 binds for severity applying here, and absence of an adverse signal SHALL NOT resolve a determination toward health, the direction-discipline of OPS6-R004 governing.
  • OPS13-R004: Movement of a determination SHALL preserve the earlier determination and the reason for the movement, in the form OPS9-R003 binds for severity applying here to condition, and a movement toward health SHALL state the evidence it rests on and SHALL NOT rest on absence. A determination SHALL be bounded to its reach, and a condition whole for one reach and partial for another SHALL be recorded as two states, the held-apart outcomes OPS11-R005 records for a return applying here to the determination's reach.
  • OPS13-R005: A derived value SHALL carry its inputs, the transformation applied, and the uncertainty the transformation introduces, and an aggregate SHALL carry the rule applied and what that rule conceals, the duties of KNOW-R037 and KNOW-R046 governing what aggregation must preserve, and the class of a derived view following INFRA12-R005. An aggregate capable of masking a severely poor component SHALL carry beside itself its weakest component and any component standing materially below it, a composite SHALL carry its components and its weighting, and a numerical score SHALL carry the discipline KNOW-R034 binds for a numerical confidence value applying here: its interpretation, its reference population or calibration basis, its units or scale, and its decision threshold, an uncalibrated score never presented as a probability.
  • OPS13-R006: A measure SHALL be read as an observation and a determination as a judgement, and neither SHALL be read as authority or permission, per KNOW-R032, KNOW-R048, and CONST-R003: no value authorizes an act, discharges a required decision, or stands in for an approval never obtained. A count of records SHALL be evidence about records and not about the things the records describe, this standard's own bar, resting on the record-kind discipline MEM-R007 binds, the count taking its own record kind and gaining none from what it counts, and a favourable measure closes no condition and discharges no obligation.
  • OPS13-R007: A change to a measure's material, question, consequence, or applicability SHALL be a recorded event breaking comparability at that point, the four-way identification KNOW-R042 binds for a class change applying here, and a series crossing such a change SHALL NOT be presented as one series. An interval in which no value could be taken SHALL be recorded as unavailable and never as a value, the distinction INFRA5-R006 binds for monitoring standing here for the record, and a correction to a value already relied upon SHALL append beside it per MEM-R009, its dependants identified.
  • OPS13-R008: A measure produced by a party about that party's own performance SHALL be recorded as that party's account and held apart from any independent basis, a determination stating which of the two it rested on. The producing, the challenging, and the validating of a measure SHALL remain distinct records or roles where practicable, combination carrying the recorded reason and compensating review OPS-R002 requires, and repeated crossings and recurring adverse periods SHALL be assessed as a sequence, the sequence duty OPS6-R005 binds on repeated requests applying here.
  • OPS13-R009: This standard defines measure records and health determinations only. It SHALL NOT observe, collect, sample, monitor, watch a threshold, raise an alert, compute a value, publish a report, or contact any party, and it SHALL NOT create authority. A measure record is never evidence that the thing it describes holds the value recorded, and a health determination is never evidence that a governed thing is in good condition.

This Draft measures nothing and determines nothing: it defines the records of measures and of health, and the health of no thing can be read from it.

Operating model and interpretation cases

My favourite failure in this whole family lives here: the dashboard that is green because collection broke. Remember it. A healthy signal and a dead sensor look identical from the comfortable chair, and I do not review from the comfortable chair; KIRYN taught me that on his perimeter, check the eyes before believing the view.

Measure review works outward from the question: whether the value answers it, whether the population and the rule could be handed to a stranger and return the same number, and whether what the record could not show stands beside what it shows. The erosions here are substitutions: activity standing in for effect, the aggregate standing in for its weakest part, silence standing in for health, and the count of records standing in for the state of the things the records describe.

  • Conforming: The value carries its question, its counted population, its rule, and its interval on its face, and a second party from the same material reaches the same number.
  • Prohibited: The party whose condition is in question supplies the only basis for determining it, and nothing in the record shows that the positions coincided or why.
  • Boundary: The rule of a measure changes, and the series is recorded as two series with the break named, rather than one account that quietly improved.
  • Failure: An interval with no value is entered as a favourable default, and an outage in observation becomes evidence of stability.
  • Loophole: The threshold is revised by the party it constrains, each revision recorded as an update rather than as a failure to meet the earlier mark, and only the sequence shows the mark walking backward.
  • Misuse: An aggregate is quoted without the component it cannot move for, so the worst part of the estate is the one thing the quoted figure cannot show.
  • Care-control: The determination records what it could not obtain and whom its reach did not cover, and no count is permitted to crowd out the qualitative account the Book protects.

Design evidence

What measure review should establish is reproducibility, and what determination review should establish is basis: each value beside its question, population, and rule; each series beside its breaks; each aggregate beside its components and its weakest member; each determination beside the material it rested on and the material it could not obtain; and each movement toward health beside the positive evidence it claims. A value that cannot be recomputed from its record is an assertion, whatever it looks like.

Where this document sits

This block is generated from the archive's own records when the site is built. It records position only and creates no authority.