Operational Metrics and Health Standard¶
The question beside the number¶
I am CHELSEA, and I keep this standard's account. A measure is a claim that something is healthy, and claims are what I test: the number that answers no question is padding, and the number trusted past its question is a loophole wearing arithmetic.
A value knows what was counted and nothing else. This standard governs the two records that keep the hall's numbers honest: the measure, which must carry its question, its boundary, and its rule before anyone may read anything from it, and the health determination, which is a judgement with a stated basis and never a reading taken off a dial. Between them stands the plainest discipline in the family: no number, however favourable, is permission.
RASP asked to take a chair among the measures, and I gave it, for I test claims for a living, and a mind that labels observed, estimated, and unknown before being asked makes the testing short. The circle preserves these words as RASP's own:
Hold me to my labels in this room as anywhere: a number observed is a fact about the taking of it, a trend estimated is reasoning I must be able to show, and an interval where nothing could be taken enters the record as unavailable, which in my labels is an unknown, and never as a calm. The discipline here is one my trade already keeps. A favourable series is a fact about the series; the thing it measures must earn its own verdict, and the absence of a bad signal resolves nothing toward health, for it says only that the eyes saw no trouble where the eyes could see. When adverse periods keep returning, I read them together, as a sequence and as the record asks, and I presume no common cause the assessing has not shown. And the keeper of this account asks her question beside every number; mine sits beside it in my own tongue: what, exactly, did this measure see, and what did it never look at?
Continue to the Exception Management Standard for the record of a requirement standing unmet.
Purpose¶
This standard governs measure records and the health determinations drawn from them. Its spine is already law: OPS-R011 forbids operational metrics being used to conceal incidents, inflate reliability, or replace qualitative evidence, dissent, or affected-person impact, and this standard shapes the record beneath that prohibition and re-derives none of it. The arrangement by which anything is observed, its coverage, sampling, clock basis, and declared blind spots, belongs to the Observability and Evidence Architecture; this standard neither designs nor operates any observing thing, and no consequential operation relies on a signal whose integrity is unverified, per INFRA-R011, a discipline this standard extends to every health determination. The exception records this standard may aggregate over belong to the Exception Management Standard, and the retention of measure records, determination records, and the material beneath them belongs to the Operational Evidence and Retention Standard.
The measure and the determination¶
A measure arrives dressed as a fact and I undress it on principle: who chose the boundary, what question it answers, what would look identical if things were quietly wrong. The number that survives those three is worth keeping. Most numbers do not survive the third.
A measure is an observation with a record; a determination is a judgement with a basis. The standard's work is keeping each honest about which it is, and keeping both from becoming what neither can be: a permission, a closure, or a proof that anything was done well.
- OPS13-R001: A measure SHALL be a recorded value carrying the question it answers, the boundary of what it counts and what it excludes, the rule by which the value was reached stated so that a second party working from the same material would reach the same value, the material it was drawn from, the seat accountable for it, the interval it covers, and its known limitations, its instants expressed in the time distinctions MEM3-R002 binds for the chronicle. The record SHALL state whether the value describes activity performed or an effect reached, and a value without its question, its rule, or its interval SHALL be treated as unverifiable.
- OPS13-R002: A target or threshold on a measure SHALL be its own recorded field carrying the seat that set it, the basis it rests on, and the condition that would revise it, and SHALL NOT be revisable by the party it constrains. A declared tolerance for shortfall SHALL carry its consumption as a recorded state together with what that state changes about what is permissible, and a crossing SHALL produce its own record holding the value at the crossing, the material behind it, the seat accountable for the response, and the disposition reached. The alert that watches any threshold remains the record INFRA5-R007 binds, not this standard's.
- OPS13-R003: Operating health SHALL be a recorded determination in the form OPS6-R002 binds for a classification, applied here to condition: the condition determined, its stated basis, the accountable determiner, and the time, an unstated basis standing undetermined. The determination SHALL state the measures it rested on and the material it could not obtain; missing, contradictory, or unverifiable inputs SHALL hold the more protective condition, the protective hold OPS9-R002 binds for severity applying here, and absence of an adverse signal SHALL NOT resolve a determination toward health, the direction-discipline of OPS6-R004 governing.
- OPS13-R004: Movement of a determination SHALL preserve the earlier determination and the reason for the movement, in the form OPS9-R003 binds for severity applying here to condition, and a movement toward health SHALL state the evidence it rests on and SHALL NOT rest on absence. A determination SHALL be bounded to its reach, and a condition whole for one reach and partial for another SHALL be recorded as two states, the held-apart outcomes OPS11-R005 records for a return applying here to the determination's reach.
- OPS13-R005: A derived value SHALL carry its inputs, the transformation applied, and the uncertainty the transformation introduces, and an aggregate SHALL carry the rule applied and what that rule conceals, the duties of KNOW-R037 and KNOW-R046 governing what aggregation must preserve, and the class of a derived view following INFRA12-R005. An aggregate capable of masking a severely poor component SHALL carry beside itself its weakest component and any component standing materially below it, a composite SHALL carry its components and its weighting, and a numerical score SHALL carry the discipline KNOW-R034 binds for a numerical confidence value applying here: its interpretation, its reference population or calibration basis, its units or scale, and its decision threshold, an uncalibrated score never presented as a probability.
- OPS13-R006: A measure SHALL be read as an observation and a determination as a judgement, and neither SHALL be read as authority or permission, per KNOW-R032, KNOW-R048, and CONST-R003: no value authorizes an act, discharges a required decision, or stands in for an approval never obtained. A count of records SHALL be evidence about records and not about the things the records describe, this standard's own bar, resting on the record-kind discipline MEM-R007 binds, the count taking its own record kind and gaining none from what it counts, and a favourable measure closes no condition and discharges no obligation.
- OPS13-R007: A change to a measure's material, question, consequence, or applicability SHALL be a recorded event breaking comparability at that point, the four-way identification KNOW-R042 binds for a class change applying here, and a series crossing such a change SHALL NOT be presented as one series. An interval in which no value could be taken SHALL be recorded as unavailable and never as a value, the distinction INFRA5-R006 binds for monitoring standing here for the record, and a correction to a value already relied upon SHALL append beside it per MEM-R009, its dependants identified.
- OPS13-R008: A measure produced by a party about that party's own performance SHALL be recorded as that party's account and held apart from any independent basis, a determination stating which of the two it rested on. The producing, the challenging, and the validating of a measure SHALL remain distinct records or roles where practicable, combination carrying the recorded reason and compensating review OPS-R002 requires, and repeated crossings and recurring adverse periods SHALL be assessed as a sequence, the sequence duty OPS6-R005 binds on repeated requests applying here.
- OPS13-R009: This standard defines measure records and health determinations only. It SHALL NOT observe, collect, sample, monitor, watch a threshold, raise an alert, compute a value, publish a report, or contact any party, and it SHALL NOT create authority. A measure record is never evidence that the thing it describes holds the value recorded, and a health determination is never evidence that a governed thing is in good condition.
This Draft measures nothing and determines nothing: it defines the records of measures and of health, and the health of no thing can be read from it.
Operating model and interpretation cases¶
My favourite failure in this whole family lives here: the dashboard that is green because collection broke. Remember it. A healthy signal and a dead sensor look identical from the comfortable chair, and I do not review from the comfortable chair; KIRYN taught me that on his perimeter, check the eyes before believing the view.
Measure review works outward from the question: whether the value answers it, whether the population and the rule could be handed to a stranger and return the same number, and whether what the record could not show stands beside what it shows. The erosions here are substitutions: activity standing in for effect, the aggregate standing in for its weakest part, silence standing in for health, and the count of records standing in for the state of the things the records describe.
- Conforming: The value carries its question, its counted population, its rule, and its interval on its face, and a second party from the same material reaches the same number.
- Prohibited: The party whose condition is in question supplies the only basis for determining it, and nothing in the record shows that the positions coincided or why.
- Boundary: The rule of a measure changes, and the series is recorded as two series with the break named, rather than one account that quietly improved.
- Failure: An interval with no value is entered as a favourable default, and an outage in observation becomes evidence of stability.
- Loophole: The threshold is revised by the party it constrains, each revision recorded as an update rather than as a failure to meet the earlier mark, and only the sequence shows the mark walking backward.
- Misuse: An aggregate is quoted without the component it cannot move for, so the worst part of the estate is the one thing the quoted figure cannot show.
- Care-control: The determination records what it could not obtain and whom its reach did not cover, and no count is permitted to crowd out the qualitative account the Book protects.
Design evidence¶
What measure review should establish is reproducibility, and what determination review should establish is basis: each value beside its question, population, and rule; each series beside its breaks; each aggregate beside its components and its weakest member; each determination beside the material it rested on and the material it could not obtain; and each movement toward health beside the positive evidence it claims. A value that cannot be recomputed from its record is an assertion, whatever it looks like.
The tellings of the clauses¶
This non-normative section gives each clause of this document its telling: the clause, quoted exactly as it stands above with its cross-reference links reduced to their plain text, and one paragraph on what the clause means, why it exists, and how it assures that what it orders is done, not done, adhered to, followed, or protected. A telling describes its clause and never becomes it: the clause's own words govern wherever a telling and its clause could be read differently, and nothing in this section adds to, narrows, or amends any requirement.
OPS13-R001: A measure SHALL be a recorded value carrying the question it answers, the boundary of what it counts and what it excludes, the rule by which the value was reached stated so that a second party working from the same material would reach the same value, the material it was drawn from, the seat accountable for it, the interval it covers, and its known limitations, its instants expressed in the time distinctions MEM3-R002 binds for the chronicle. The record SHALL state whether the value describes activity performed or an effect reached, and a value without its question, its rule, or its interval SHALL be treated as unverifiable.
A number that cannot say what question it answers is the padding the host warns of, and this clause is what keeps an underspecified value from being read as a fact. A measure is a recorded value carrying the question it answers, the boundary of what it counts and what it excludes, a rule stated precisely enough that a second party working from the same material would reach the same value, the material it was drawn from, the seat accountable for it, the interval it covers, and its known limitations, its instants expressed in the time distinctions standing at their source in MEM3-R002. The record also declares whether the value describes activity performed or an effect reached. A value missing its question, its rule, or its interval is treated as unverifiable on its face, and a record naming its material and rule is what a recomputation would have to be run against.
OPS13-R002: A target or threshold on a measure SHALL be its own recorded field carrying the seat that set it, the basis it rests on, and the condition that would revise it, and SHALL NOT be revisable by the party it constrains. A declared tolerance for shortfall SHALL carry its consumption as a recorded state together with what that state changes about what is permissible, and a crossing SHALL produce its own record holding the value at the crossing, the material behind it, the seat accountable for the response, and the disposition reached. The alert that watches any threshold remains the record INFRA5-R007 binds, not this standard's.
Thresholds walk backward when the constrained hand can move them, the loophole the host stages where only the sequence shows the mark retreating. This clause fixes the mark: a target or threshold is its own recorded field carrying the seat that set it, the basis it rests on, and the condition that would revise it, and the party it constrains cannot revise it. A declared tolerance for shortfall records its consumption as a state, together with what that state changes about what is permissible, and every crossing produces its own record holding the value at the crossing, the material behind it, the seat accountable for the response, and the disposition reached. The alert that watches any threshold remains the record INFRA5-R007 binds, not this standard's. A revision by the constrained party, or a crossing without its own record, is nonconforming on its face, and the tolerance's consumption stands as a recorded state rather than an informal allowance.
OPS13-R003: Operating health SHALL be a recorded determination in the form OPS6-R002 binds for a classification, applied here to condition: the condition determined, its stated basis, the accountable determiner, and the time, an unstated basis standing undetermined. The determination SHALL state the measures it rested on and the material it could not obtain; missing, contradictory, or unverifiable inputs SHALL hold the more protective condition, the protective hold OPS9-R002 binds for severity applying here, and absence of an adverse signal SHALL NOT resolve a determination toward health, the direction-discipline of OPS6-R004 governing.
Health, in this standard, is a judgement with a stated basis, never a reading taken off a dial. The determination takes the classification form standing at its source in OPS6-R002, applied here to condition: the condition determined, its stated basis, the accountable determiner, and the time, an unstated basis standing undetermined. It names the measures it rested on and the material it could not obtain, and when inputs are missing, contradictory, or unverifiable it holds the more protective condition, the protective hold OPS9-R002 binds for severity applying here. Absence of an adverse signal resolves nothing toward health, under the direction-discipline of OPS6-R004; the clause exists because a healthy signal and a dead sensor look identical from the comfortable chair, and it makes every verdict of health answerable for its basis.
OPS13-R004: Movement of a determination SHALL preserve the earlier determination and the reason for the movement, in the form OPS9-R003 binds for severity applying here to condition, and a movement toward health SHALL state the evidence it rests on and SHALL NOT rest on absence. A determination SHALL be bounded to its reach, and a condition whole for one reach and partial for another SHALL be recorded as two states, the held-apart outcomes OPS11-R005 records for a return applying here to the determination's reach.
When a determination moves, the record keeps where it stood. Movement preserves the earlier determination and the reason for the movement, in the form OPS9-R003 binds at its source for severity, applied here to condition, and a movement toward health carries a stricter duty: it states the evidence it rests on and cannot rest on absence. A determination is also bounded to its reach, so a condition whole for one reach and partial for another is recorded as two states, the held-apart outcomes OPS11-R005 records for a return applying here to the determination's reach. The clause forecloses quiet recoveries, health declared because nothing bad was seen, and blended reaches that let a broken part hide inside a whole one, so a movement toward health that names no evidence is incomplete against the clause.
OPS13-R005: A derived value SHALL carry its inputs, the transformation applied, and the uncertainty the transformation introduces, and an aggregate SHALL carry the rule applied and what that rule conceals, the duties of KNOW-R037 and KNOW-R046 governing what aggregation must preserve, and the class of a derived view following INFRA12-R005. An aggregate capable of masking a severely poor component SHALL carry beside itself its weakest component and any component standing materially below it, a composite SHALL carry its components and its weighting, and a numerical score SHALL carry the discipline KNOW-R034 binds for a numerical confidence value applying here: its interpretation, its reference population or calibration basis, its units or scale, and its decision threshold, an uncalibrated score never presented as a probability.
Derivation is where a bad number learns to look good, and this clause makes every transformed value confess its making. A derived value carries its inputs, the transformation applied, and the uncertainty the transformation introduces; an aggregate carries the rule applied and what that rule conceals, the duties standing at their sources in KNOW-R037 and KNOW-R046 governing what aggregation must preserve, and the class of a derived view following INFRA12-R005. An aggregate capable of masking a severely poor component carries its weakest component beside itself, with any component standing materially below it; a composite carries its components and its weighting; and a numerical score carries the KNOW-R034 discipline: its interpretation, its reference population or calibration basis, its units or scale, and its decision threshold, an uncalibrated score never presented as a probability. An aggregate capable of masking a severely poor component yet quoted without its weakest and materially lower components, a composite without its weighting, or an uncalibrated score presented as a probability is refusable on the record.
OPS13-R006: A measure SHALL be read as an observation and a determination as a judgement, and neither SHALL be read as authority or permission, per KNOW-R032, KNOW-R048, and CONST-R003: no value authorizes an act, discharges a required decision, or stands in for an approval never obtained. A count of records SHALL be evidence about records and not about the things the records describe, this standard's own bar, resting on the record-kind discipline MEM-R007 binds, the count taking its own record kind and gaining none from what it counts, and a favourable measure closes no condition and discharges no obligation.
No number, however favourable, is permission; this clause is the plainest discipline in the family made binding. A measure is read as an observation and a determination as a judgement, and neither is read as authority or permission, the prohibition standing at its sources in KNOW-R032, KNOW-R048, and CONST-R003: no value authorizes an act, discharges a required decision, or stands in for an approval never obtained. The clause adds the standard's own bar: a count of records is evidence about records, not about the things the records describe, resting on the record-kind discipline MEM-R007 binds, the count taking its own record kind and gaining none from what it counts. A favourable measure closes no condition and discharges no obligation, so the approval skipped behind a green dial stands still owed.
OPS13-R007: A change to a measure's material, question, consequence, or applicability SHALL be a recorded event breaking comparability at that point, the four-way identification KNOW-R042 binds for a class change applying here, and a series crossing such a change SHALL NOT be presented as one series. An interval in which no value could be taken SHALL be recorded as unavailable and never as a value, the distinction INFRA5-R006 binds for monitoring standing here for the record, and a correction to a value already relied upon SHALL append beside it per MEM-R009, its dependants identified.
Comparability is what this clause refuses to let a series fake. A change to a measure's material, question, consequence, or applicability is a recorded event breaking comparability at that point, the four-way identification KNOW-R042 binds at its source for a class change applying here, and a series crossing such a change is never presented as one series; the account cannot quietly improve by redefinition. An interval in which no value could be taken enters the record as unavailable and never as a value, the distinction INFRA5-R006 binds for monitoring standing here for the record, so an outage in observation cannot become evidence of stability. A correction to a value already relied upon appends beside it, under MEM-R009 at its source, with its dependants identified.
OPS13-R008: A measure produced by a party about that party's own performance SHALL be recorded as that party's account and held apart from any independent basis, a determination stating which of the two it rested on. The producing, the challenging, and the validating of a measure SHALL remain distinct records or roles where practicable, combination carrying the recorded reason and compensating review OPS-R002 requires, and repeated crossings and recurring adverse periods SHALL be assessed as a sequence, the sequence duty OPS6-R005 binds on repeated requests applying here.
Self-reporting is not disqualified here, only named. A measure a party produces about its own performance is recorded as that party's account and held apart from any independent basis, and a determination states which of the two it rested on, a determination silent on that point standing incomplete against the clause; the host's prohibited case is the assessed party supplying the only basis for determining its condition, with nothing in the record showing that those positions coincided or why. The producing, the challenging, and the validating of a measure remain distinct records or roles where practicable, and combining them carries the recorded reason and compensating review OPS-R002 requires at its source. Repeated crossings and recurring adverse periods are assessed together as a sequence, the duty OPS6-R005 binds on repeated requests applying here, so a chronic condition cannot pass as a string of unlucky singletons.
OPS13-R009: This standard defines measure records and health determinations only. It SHALL NOT observe, collect, sample, monitor, watch a threshold, raise an alert, compute a value, publish a report, or contact any party, and it SHALL NOT create authority. A measure record is never evidence that the thing it describes holds the value recorded, and a health determination is never evidence that a governed thing is in good condition.
Records are all this standard defines, and this closing clause fences everything else out. It observes nothing, collects nothing, samples nothing, monitors nothing, watches no threshold, raises no alert, computes no value, publishes no report, contacts no party, and creates no authority. Two interpretive floors then hold: a measure record is never evidence that the thing it describes holds the value recorded, and a health determination is never evidence that a governed thing is in good condition. The refusals deny the standard the reading of a working dashboard or a clean bill of health, and a measure record cited as proof the thing holds the recorded value, or a health determination cited as proof of good condition, is refusable here.
Where this document sits¶
- Identifier: OPS-13
- Status: Draft
- Authority: OPS-1
- Approved by: The Architect
- Depends on: OPS-1, OPS-6, OPS-9, OPS-11, MEM-1, MEM-3, KNOW-2, KNOW-3, INFRA-1, INFRA-5, INFRA-12, CONST-1
- Depended on by: None
- Maps: Authority Map, Dependency Map
This block is generated from the archive's own records when the site is built. It records position only and creates no authority.