Result · SCORE-ERROR-RULE-TRANSFER
Applying a rule to the proxy instead of the truth costs a margin-controlled amount
Proved hereindependently auditedpublication: internalprior art found
Meaning
The mass of events the rule labels differently on the estimated score is bounded through a margin condition at the cell boundaries, and the retained information changes by at most an explicit matrix of the mislabelled mass.
Statement
Frozen rule q on score space, Z = q(s), Z_hat = q(s_hat), s_hat = s + e, both retained informations computed from the true s; M = {Z != Z_hat}, pi = P(M). (i) If q(s_hat) != q(s) then dist(s, boundary of the cell of q(s)) <= ||e|| in any norm (the segment [s, s_hat] is connected); for a nearest-centre rule with positive-definite metric G, distinct centres and distance measured in G the squared distance is min_{b' != b} (||s - mu_b'||_G^2 - ||s - mu_b||G^2)^2 / (4 ||mu_b - mu_b'||G^2), rational on rational data. Hence with the margin function M_q(t) = P(dist_V(s, boundary q) <= t) and eps^2 = E[e^T V^{-1} e]: pi <= inf_t {M_q(t) + eps^2 / t^2}; if M_q(t) <= C t^alpha then pi <= (1 + alpha/2)(2/alpha)^(alpha/(alpha+2)) C^(2/(alpha+2)) eps^(2 alpha/(alpha+2)), i.e. pi <= 1.89 C^(2/3) eps^(2/3) at alpha = 1. (ii) With c_b the Z-cell means and c_hat_b the Z_hat-cell means of s: I_Zhat >= I_Z - Gamma and I_Z >= I_Zhat - Gamma_hat in the Loewner order, Gamma = 2 E[(s s^T + c{Z_hat} c{Z_hat}^T) 1_M], Gamma_hat = 2 E[(s s^T + c_hat_Z c_hat_Z^T) 1_M]. Corollaries: |tr R_Z - tr R_Zhat| <= 2 E[||w||^2 1_M] + 2 pi max_b max(||c'_b||^2, ||c_hat'b||^2) (whitened); log eta_D(Z_hat) - log eta_D(Z) >= log(1 - gamma_R) with gamma_R = tr(I_Z^{-1} Gamma) <= tr(V^{-1} Gamma)/rho_min and tr(V^{-1} Gamma) = 2 E[(||w||^2 + ||c'{Z_hat}||^2) 1_M], symmetrically above; order O(pi) for uniformly bounded whitened scores; O(sqrt pi) under a uniform fourth moment and stable positive base-cell masses as specified in the assumptions. Determinant rates also require a retained eigenvalue floor. Composed with (i) at alpha = 1: O(eps^(2/3)) bounded, O(eps^(1/3)) with a fourth moment. Without a margin condition nothing holds: CE-SCORE-ERROR-BOUNDARY-ATOM-001 has an atom of mass 1/2 on a cell boundary, pi = 1/2 for every eps > 0 and the retention jumps 4/5 -> 1/2.
Assumptions
One law on x-space with finite second moments; fixed measurable cells with topological boundary distance in the same positive-definite norm used for the error. Distinct centres are required only for the Voronoi distance formula; ties follow a fixed convention.
The margin power law has C>0, alpha>0 and must hold at t*=(2 eps^2/(alpha C))^(1/(alpha+2)); otherwise optimize only over its valid range. Cap probability bounds by one. Zero error gives no disagreement. The exponent 2 alpha/(alpha+2) is for the L2 norm, not its square.
Both label maps take values in the same finite alphabet. A conditional centroid of a zero-mass cell is set to zero, including when reused by the other labeling; the Loewner inequalities need only finite second moments.
The determinant comparison requires I_Z positive definite and gamma_R<1; a reverse finite logarithmic comparison requires the corresponding proxy-label matrix and budget. The trace comparison needs no retained-rank condition.
Asymptotic O(sqrt pi) transfer: fixed law, finite base partition with minimum positive occupied mass p*>0, finite fourth whitened moment, pi->0. On original occupied cells p_hat>=p*/2 eventually, bounding their new centroids; original empty cells are null in the reverse cross-centroid term. Uniform statements over changing laws/rules require uniform fourth moments and p*. Determinant rates additionally require a uniform retained eigenvalue floor.
Measured quadrature values and finite exact searches are evidence only. This is a deterministic rule-transfer inequality, not a refitted-rule CLT or an excess Bayes-risk theorem.
the boundary-displacement half of OPEN-SCORE-PERTURBATION: the loss of deploying a frozen rule on the proxy instead of the truth; with SCORE-ERROR-RETENTION-BUDGET it composes into the deployed-versus-oracle budget of O8.6
Where it stops
Audited after explicit metric, empty-cell, margin-range and rate assumptions. The Markov/margin argument is published comparison machinery; the Loewner sandwich is the project reduction. The bound is often vacuous at measured door3 error scales.
Bounded by
- CE-SCORE-ERROR-BOUNDARY-ATOM-001
The mislabel mass P(q(s_hat) != q(s)) of a frozen rule tends to zero with the score error epsilon without a margin condition on the law at the cell boundaries. Refuted: an atom of mass 1/2 sits on the boundary of the threshold rule Z = 1{s > 0}; every proxy that lifts it by kappa > 0 relabels it, so pi = 1/2 for every epsilon > 0 and the true retention of the transferred labels jumps from 4/5 to 1/2. The margin function M(t) = P(dist_V(s, boundary) <= t) is >= 1/2 for all t > 0, so the SCORE-ERROR-RULE-TRANSFER bound pi <= inf_t {M(t) + epsilon^2/t^2} is vacuous, as it must be.
Closest prior work
Relationships
Rests on
- True retained Fisher information under a score proxyPROXY-TRUE-RETAINED-FI
- Normalized retained-information spectrumINFO-RETENTION-SPECTRUM
- Reported versus true retention of a frozen label map under a score error: an exact two-term expansion in the Fisher-whitened score errorSCORE-ERROR-RETENTION-BUDGET
The full chain beneath it
- Quantized Fisher-information identityFI-QUANT-IDENTITY
- Exact Fisher-information loss decompositionFI-LOSS-DECOMPOSITION
- Representation loss and hard-quantization loss separateREPRESENTATION-QUANTIZATION-LOSS
- D-efficiency relative to unbinned inferenceINFO-D-EFFICIENCY
- D-optimal partition invariance under invertible reparameterizationD-REPARAM-INVARIANCE
Enables
- Perturbation theory for estimated scoresOPEN-SCORE-PERTURBATION
- Measured score-error budget on the door3 classifier rungs and a d = 2 mixture lawSCORE-ERROR-DOOR3-MEASURED
Raises
Open next door
- Perturbation theory for estimated scoresOPEN-SCORE-PERTURBATION
- Direction-wise guarantees from determinant efficiencyOPEN-D-DIRECTIONAL-BOUND
- Sharp D-efficiency bounds versus KOPEN-D-EFFICIENCY-VS-K
- Estimate representation versus quantization lossOPEN-REPRESENTATION-LOSS-ESTIMATION
- Finite-sample uncertainty for retention estimatesOPEN-RETENTION-UNCERTAINTY
Local graph
Proof
O8. Score-error budget for a frozen rule: what an estimated score costs, to first order
Recorded 8 September 2026 by the SCORE-ERROR-BUDGET session (study
SCORE-ERROR-BUDGET, closure step 3 of OPEN_PROBLEMS.md; git history).
Verdict: proved at the first order asked for — the gap between the retention the
library reports for a proxy score and the true retention of the same labels is an
exact two-term expansion with an explicit curvature remainder (O8.2), the rule-transfer
loss is a Markov-plus-margin bound composed with an exact Loewner sandwich (O8.3), and
the classifier-calibration chain is one Lipschitz inequality plus the Brier identity
(O8.4). Instrument py/score_error_budget.py; artifacts under
artifacts/SCORE-ERROR-BUDGET/. Independently audited and corrected on 8 September 2026:
AUDITS/AUDIT-SCORE-ERROR-BUDGET-001.md. The core budget survives; the alignment-bound ordering,
linear-reduction domain, and classifier lower-bound/deployment readings required correction.
Cite versus derive. The independent five-source triangulation is in
LITERATURE/audits/SCORE-ERROR-RETENTION-BUDGET-2026-09-08.md.
Boyd–Vandenberghe supplies log-det concavity; Audibert–Tsybakov supplies the
margin/Markov comparison method; Bröcker supplies the proper-score decomposition;
Barnes–Han–Özgür and Cranmer–Pavez–Louppe supply the information and classifier
reductions. The specific retention expansion has a search gap, not a novelty claim.
O8.0 Normalized target (protocol A)
- Level:
information_accounting, conditional on a frozenempirical_inductive_quantizer. Criterion: D (the geometric-mean retention,INFO-D-EFFICIENCY) for O8.2; every direction (INFO-RETENTION-SPECTRUM) for O8.1; the trace and the determinant for O8.3. - Frozen: provider , rule on score space, reference point , . No sampling limit is taken. Every statement is an inequality between functionals of one law on -space — population or empirical. For the empirical law of a sample on which both and exist the inequalities hold sample-wise, exactly; combined with O7 the reported number on a held-out sample is off by a sampling term (O7) plus a bias term (here), controlled separately.
- Objects. True score , proxy , , . Labels with . Cell means , , . True retained information ; reported . Error matrices , .
- Scales. The Fisher-whitened score error and its cell-averaged and
retention-weighted versions,
with eigenvalues
(U7); ; is the rule's trace
information loss. All of are
invariant under , nonsingular
(
D-REPARAM-INVARIANCE). - What the library prints. For a supplied proxy score array the library's
information_report(...).geometric_mean_retentionis whenever andrank_rtolprojects nothing (O7.1 applies verbatim to any supplied array; the library never knows whether it was given or ). The quantity of interest is , the true retention of the same labels (O4). - Not used. is never used in O8.1–O8.3; it is what makes the
Fisher retention (U1,
FI-QUANT-IDENTITY). is allowed throughout. Weights are the law. Excluded: the rank projection at singular (as in O7); rules refitted on the evaluation sample; ; sampling variability.
O8.1 Directional reporting budget — [PROJECT_PROVED]
Lemma 1 (conditional Jensen, matrix form). , hence . Proof. and the cross terms equal by the tower property, so .
Proposition B1. , and for every
Proof. Expand and sum; the middle term is , bounded by Cauchy–Schwarz with and . The second line is the same with in place of .
Reading. In whitened coordinates a direction that retains is misreported by at most , the full information by at most . The quadratic error term can add information in any direction; its relative effect is amplified where true retention is small. For a fixed direction with nonzero projected true second moment, equality in Cauchy–Schwarz requires almost surely; if that second moment vanishes, equality is automatic. This is not vector proportionality.
O8.2 D-retention reporting budget — [PROJECT_PROVED]
Throughout, and, for , .
Lemma 2 (trace core). For , , and : and , because . Equality iff a.s. for a constant .
Lemma 3 (rank-one Loewner bound). For , (the difference is ). Hence , and since , at (zero error is exact equality): .
Lemma 4 (log-det brackets). Let be the eigenvalues of (all ). Concavity gives . For : Lemma 3 gives ; and put . The exact integral identity
gives , because
throughout the interpolation.
The original scalar assertion with positive was false
(CE-SCORE-ERROR-LOG-LOWER-001); the final epsilon-based bound is unchanged.
Together with
(primes: -whitened) gives the second member of . So
Theorem B2 (two-term expansion with curvature remainder). Let (), , and . Then
with the bounds
(a) alignment term:
The two bounds are independent: use their minimum, not a chained ordering
(CE-SCORE-ERROR-ALIGNMENT-ORDER-001). The curvature term is second order,
not a cubic Taylor remainder; is not the entire quadratic Taylor coefficient.
The small-error conditions imply positive definiteness of both proxy matrices.
(b) spurious-information term: , so and ;
(c) crude bracket (no expansion): , first order .
Proof. Apply Lemma 2 and Lemma 4 to and to and subtract; the linear parts are , the -parts , the curvature parts . For (a) whiten by (, , , ): and by the tower property, so
with operator norm and ; Cauchy–Schwarz in the inner product bounds the first expectation by . For the second, and (Pythagoras). The separate crude inequality of (a) is Lemma 2 applied to each expectation separately. For (b), by definition of , so . (c) is Lemma 4 twice.
Sharpness of the numerator first-order constant (not the retention-ratio bound). With for every cell (the
proxy stretches each cell mean by the same factor), Lemma 2 is an equality,
and , so the numerator gap
attains to first order, in both signs of
. The instrument verifies both identities exactly in (selftest).
Necessity of the retention scale. No finite uniform relative/log reporting bound from an upper bound on alone exists:
CE-SCORE-ERROR-RHO-MIN-NECESSARY-001 is a , three-cell, centred atomic family with
uniformly bounded in which runs
as runs ; the
weak-direction error scale is . A proxy error of in the
whitened metric, aligned with a direction the rule barely retains, reports more
retention than there is.
Invertible linear reduction. For fixed labels, is unchanged by
with nonsingular. Transform a rule as
to preserve its labels; feeding transformed scores to an
unchanged rule does not do this. Translations are not invariances of uncentred moments
(CE-SCORE-ERROR-TRANSLATION-001). Every reporting bound therefore applies with
, with all error scales recomputed for those same labels.
The unconstrained least-squares matrix is , and
where are uncentred canonical correlations. This identity holds even when
is singular; applying the unchanged-retention budget at requires
nonsingular. Otherwise it only gives the infimum error over
invertible maps (by approximation), not an admissible minimizer or a finite bracket
at the singular limit (CE-SCORE-ERROR-SINGULAR-LS-001). If
, the cross moment is necessarily full rank: one zero
canonical correlation would already contribute one unit. The original measured
artifact keys eps_aff and table notation denote this linear, zero-intercept reduction.
The deployable direction. The roles of and are symmetric
(); with ,
, where
is the smallest reported retention eigenvalue (the library's
directional diagnostic, INFO-DIRECTIONAL-DIAGNOSTICS), the same expansion bounds
. So a user with a reported , a reported
, a reported trace loss, and an error budget in the proxy metric has a bracket
for the truth when the stated small-error conditions hold. O8.4 directly bounds the
true metric; converting it requires additional spectral control or evaluation of both
metrics on a truth-labelled simulation hold-out. Verified exactly in selftest
(backward).
Endpoints. At ( singular, e.g. at the reference law, U4) the expansion is void and the reported number can be anything in : the limit of the fixture. When the lower bracket is void and the reported information can indeed vanish ( gives with ). Neither is a defect of the bound.
O8.3 Rule transfer under a margin condition — [PROJECT_PROVED]
Now the rule is applied to both scores: , , both retentions computed from the true . , .
Proposition B3 (i) (mislabel mass). If then in any norm — the segment is connected, meets and its complement, hence its boundary. For a nearest-centre rule with positive-definite metric and distinct centres, in that same metric the distance from in cell to the boundary of is , so its square is rational on rational data and the instrument checks the pointwise statement exactly in the metric. Markov's inequality then gives, with the margin function ,
(: ). Here , and the minimizing must lie in the range of the margin hypothesis; otherwise minimize over the admissible range and cap by one. Zero error gives zero disagreement directly. The powers are correct for ; if the input is the squared error, its exponent is . This is the comparison method of Audibert–Tsybakov, §5, with spatial cell-boundary distance replacing posterior distance to the Bayes boundary. Their excess-risk exponent concerns a different, margin-weighted loss.
Proposition B3 (ii) (label-perturbation sandwich). With the -cell means and the -cell means of the true score, set either centroid to zero when its own cell has zero mass; use the same finite label alphabet. Then
Proof. , , within-scatters , , and . For any -measurable , (Pythagoras: ). Take , which equals off : . So , i.e. ; swap roles for the other side.
Corollaries. Trace: (whitened). Determinant: with , , and symmetrically above; with . Orders: bounded whitened scores give for the trace loss (constant ). For a fixed base law and frozen rule with finitely many positive-mass occupied cells, a fourth moment and a uniform bound on the centroids of the compared rules give by Cauchy–Schwarz. The centroid condition holds for small perturbations of this fixed partition: original occupied masses remain bounded below; labels originally empty receive only mislabelled points, whose fitted centroid is only used on the reverse side for original points of that label, a null event. Across varying laws or rules, require uniform fourth moments and a common positive lower bound on nonempty base-cell masses. The determinant orders additionally require a uniform retained eigenvalue floor and eventually . Composing at gives for bounded scores and with these fourth-moment conditions. The earlier atom-at- illustration has diverging fourth moment and establishes no sharpness of this fourth-moment rate.
Necessity of the margin. CE-SCORE-ERROR-BOUNDARY-ATOM-001: a scalar centred law
with an atom of mass on the boundary of the threshold rule; any proxy lifting it
by has , jumps , and for all
makes (i) vacuous. The sandwich holds with — the budget is a function
of the mislabel mass, and nothing makes the mass small.
O8.4 Classifier calibration to score error (OPEN-CLASSIFIER-CALIBRATION-FI) — [BRIDGE]
Per O3 (CLASSIFIER-MIXTURE-SCORE-FORMULA), with posteriors
under training priors , ,
and .
Proposition B4. For interior, on the simplex: (since ), (since ), and for
from . Hence with , . The score is a fixed linear image (for a normalized mixture, use the tangent chart, e.g. component-minus-reference differences; ), so with :
the second step because . Under the training mixture with one-hot component label , is the excess Brier score (), and it splits orthogonally as
Reliability is a population functional that can be estimated from independent labelled data using a justified calibration estimator; naive finite binning/isotonic fits are not an exact certificate. Excess Brier error requires the Bayes reference score or truth posteriors, which simulation can supply.
For completeness, the inverse map on the image is , . Subtracting two ratios gives the explicit bound
using . Thus posterior and full component-ratio errors are equivalent. They are not equivalent to score error for an arbitrary chart. Write and . Only if and ,
The full free-fraction chart is injective on ; reduced parameter submodels
need not be (CE-CLASSIFIER-CALIBRATION-CHART-001). This lower bound includes
constants and concerns squared error, not retention distortion.
Consequence. Excess Brier error gives an upper score-error budget, which O8.2
converts into a conditional reporting bound. Calibration alone does not certify small
error because the resolution gap is unobserved. Conversely, bad calibration does not
certify distortion of reported retention: even a full chart can produce an invertible
rescaling of the true score (CE-CLASSIFIER-CALIBRATION-RETENTION-001). The forward
constants remain valid. The original selftest tested 300 simplex pairs / 940 coordinates,
not 940 pairs, and did not test either false lower-bound inference. This is a bridge
from the published Brier decomposition, with explicitly checked project constants.
O8.5 AUC is not enough — [COUNTEREXAMPLE]
CE-AUC-INVARIANT-PROXY-RETENTION-001: the scalar law , equal
weights, threshold rule at , true retention . Two strictly increasing
distortions of the score — the same ranking, the same ROC curve for every threshold,
the same family of rank-cut labels under corresponding thresholds (and the same fixed zero-threshold labels), the same true retention — report
(compress within cells) and (stretch one atom). In a strictly monotone
preserves rank cuts after the thresholds are transformed; it need not preserve
a fixed numerical threshold. It moves the reported uncentred second-moment ratio of across an interval; with unequal atom weights
arbitrarily close to . Ranking quality is not the relevant classifier metric;
the whitened error is (O8.2), and it is not a function of the ROC curve.
O8.6 Deployment corollary — [PROJECT_PROVED]
Let be the reported retention of the labels , their true retention and the true retention of . For the rule fitted on the proxy and any comparison rule (e.g. the oracle optimum on ) with — true of the global proxy optimum, and of an exchange-stable solution only if it happens to beat on the proxy objective —
where, for , define using O8.2, and assume all retentions in this chain are positive and the transfer budget . The correct chain is
Apply O8.3 to finish. The over-reporting budget belongs to the selected rule; the under-reporting budget belongs to the comparator. There is no free substitution for a fixed oracle comparator. A change of score coordinates must transport the rule, the metric, and the comparator together; otherwise it is a new comparison with a new target. The corollary still needs truth-based budgets for two rules and proxy-objective dominance; exchange stability alone supplies neither.
O8.7 Measured (protocol D, run before and after the derivation) — [MEASURED]
Instrument py/score_error_budget.py; records in artifacts/SCORE-ERROR-BUDGET/.
-
selftest(exact, 400 random atomic laws, , , , unequal weights, duplicate atoms, singleton cells, constant error shifts, three error scales; 22 942 checks; failures): Lemma 1, B1 on axis and random directions, the Lemma 2 cores for numerator and denominator, Lemma 3 at , the float brackets of Lemma 4 and of B2(c), the exact against each B2(a) bound separately and the remainder bracket, , the linear identity and admissible invariance, the backward direction, B3 (i) pointwise on nearest-centre rules in the metric, B3 (ii) both sandwiches and the trace corollary on random second labellings, B4 on 300 simplex pairs (940 coordinate checks); the sharpness attainer identities in (). -
door3(the classifier example;examples/door3_classifier.pyrungs rebuilt through the O6 audit's closed forms; all population quantities by cut-aligned QUADPACK; , ):rung true reported ratio / / aff B2(a) sharper / aff B2 crude / aff B3 (i) bound 15 0.8937 0.9671 0.0789 0.500 / 0.416 0.447 / 0.347 0.084 0.270 / 0.240 1.89 / 1.53 0.106 0.275 1.00 60 0.9557 0.9710 0.0159 0.289 / 0.235 0.262 / 0.200 0.025 0.079 / 0.073 1.10 / 0.87 0.044 0.186 1.00 300 0.9716 0.9738 0.0023 0.096 / 0.067 0.091 / 0.061 0.0028 0.016 / 0.013 0.37 / 0.26 0.028 0.051 0.45 Reading: the door3 classifier's whitened score error is large (50% at the smallest rung) while the reported retention is only 8% off — the two cancellations of B2(a) at work (a mostly linear error, uncentred correlation ; a nearly lossless rule, ). The crude first-order budget over-covers by , the sharper alignment bound by –, and itself tracks the gap to within the curvature remainder. The rule applied to the true score retains more () than the proxy labels (); both sandwiches hold (). The margin bound (i) is vacuous at rungs 15 and 60 () and against at rung 300: B3 (i) is informative only for . Recorded values of O6/O7 for and the proxy reproduce to rounding.
-
synthetic2d(the O7 bounded three-component mixture, , , , ; proxies: a mis-specified template with all component means shifted by , and at each matched an error of that size aligned with the weakest and with the strongest retained whitened direction, sign-correlated with the cells): every row inside the B2(c) bracket; for the weak-direction proxy against for the strong-direction proxy at the same — the gap here is the term ( versus ), stays below on every row, and reproduces the weak-direction gap to at . The template shift admits a linear least-squares reduction (, canonical correlations ) and reports within up to .
O8.8 Self-adversarial pass (protocol G) and verdict (protocol H)
- Ties, duplicates, singleton cells: all statements are about laws; the instrument's grid includes duplicate atoms and singleton cells. Empty cells contribute nothing () and are excluded from every sum. Singular information: B1 and B3 need nothing beyond finite second moments; a finite B2 logarithm needs (endpoints above); the library's rank projection is outside every statement, as in O7. Nuisance/: not covered. Atomic laws: the proofs are for arbitrary laws; every fixture is atomic. Hidden compactness: none in B1, B2, B3 (ii); B3 (i)'s exponent needs a margin function, and bounded or fourth-moment scores set the -to-retention order. First-order to finite: every bracket is non-asymptotic; the "first order" readings are the forms. Empirical to population: the inequalities hold for every finite law, hence sample-wise for the library's number when both scores are on the sample; no limit is taken. : allowed and exercised. Weights: the law. Score estimation error: the subject. New events: the rule is frozen; O8.3 is the new-event statement. Dependence of on : irrelevant to O8.1–O8.2 (labels are labels), handled in O8.6 by the proxy-optimality step, which is the one place where an exchange-stable (non-global) solution weakens the statement.
- Information-loss implication (H). O8.2 bounds — reported versus true geometric-mean retention of the deployed labels — by the alignment term and the spurious-information term ; O8.1 does it per direction; O8.3 bounds the loss of applying the rule to the proxy instead of the truth; O8.6 composes them into the deployed-versus-oracle loss. Train-only versus held-out is not the axis here (O7 is).
- Verdict. Proved (B1, B2, B3, B6 project level; B4 bridge; B5 fixture).
OPEN-SCORE-PERTURBATIONis settled at first order for a frozen rule;OPEN-CLASSIFIER-CALIBRATION-FIis half-settled: the chain from posterior error to score error is one inequality, and a calibration-to-score lower bound needs an injective chart and explicit constants; it is not a lower bound on retention distortion. Open remainder, backlog not theme: a uniform-over-rules budget together with a proxy optimization-gap certificate (uniform perturbation control alone does not make an exchange-stable solution globally optimal); the /profiled retention; refitted rules; second-order sharp constants for ; the resolution gap without truth scores (OPEN-REPRESENTATION-LOSS-ESTIMATION's cross-fitting). - Product consequence. Closure step 1's docs sentence must say: the printed
retention for a classifier provider is the reported number; its distance to the
true retention is at first order plus
in the classifier's whitened score error, small for a
nearly lossless rule with a well-calibrated, well-resolved classifier, and not
controlled by AUC; the O7 error bar covers sampling only.
OPEN-PARAMETER-MISMATCH(closure step 4): a score shift under the reference law is an instance of O8.2; the law shift is not, and remains step 4's content.
Independently audited: the reporting and transfer budgets survive after corrections. The audit report.
Evidence: py/score_error_budget.py. Measured, never theorem authority.