Counterexample · DS-TILT-DUAL-STRONG-DUALITY-FAILS
The profiled dual gap can be strictly positive
Counterexampleindependently auditedpublication: internalno direct precedent found
Meaning
Exact finite witnesses show a genuine primal–dual gap; a nonclosing reported bracket alone does not prove such a gap.
Scientific context
Strong duality between the tilt primal and dual is false in general, and the gap can be order one rather than a rounding artifact: an exact four-row, three-cell table has a gap above 0.68, and the smallest possible witness — three rows, two cells — has an exact gap of 1/6.
This should not be read as surprising: minimax interchange on a finite nonconvex feasible set is expected to fail in general, and the contribution is the exact witnesses rather than the phenomenon itself. Separately, a reported non-closing bracket is not evidence that a duality gap exists — a tie in the dynamic program can let a deterministic policy return a labelling that hides an available closure — so certification requires exhibiting the specific closing labelling rather than merely reporting an interval.
Statement
An exact equal-weight N=4, K=3, d_psi=d_lambda=1 table (CE-DS-TILT-DUAL-GAP-001) has all six nonempty partitions regular, global profiled value 116805/11816, and tilt dual at least 61717893/5839400 by an exact convex mixture of two active partition quadratics; its exact dual minimum is 44729/4232 at the rational crossing beta*=-8/23, so the exact gap is 534361/781333 > 0.68 even though the DS9 and DS11 domains coincide. The witness is support-minimal for K=3. The overall support minimum is N=3, K=2: CE-DS-TILT-DUAL-GAP-002 (rows (-1,0),(0,-1),(1,0), equal weights) has g^+=1/3 and exact d=1/2 at beta*=0, gap 1/6, with a fully rational mixture proof. A positive-weight bounded augmentation family with vanishing added mass preserves the global-versus-dual gap asymptotically, so the gap is Theta(1), not a finite-grid artifact.
Assumptions
uncentered finite score table with positive rational weights and exactly K nonempty cells
the asymptotic family uses distinct bounded rational added atoms of vanishing total mass and does not assume unrestricted split-duplicate invariance; it proves d_r - g_r^+ -> d - g only (p_r^+ <= g_r^+ makes the primal gap at least as large); its constants are large (measured r|d_r-d| <= 12.6 for r<=6), so finite-r gaps are far below the limit
the two-quadratic mixture is a rational lower certificate on d; the exact minimizer is a separate computation (rational here, quadratic-irrational in general)
Where it stops
Audited 2 Sep 2026: verified; 'support-minimal' corrected to K=3-minimal, with CE-DS-TILT-DUAL-GAP-002 as the overall minimum. This falsifies universal strong duality, not weak validity of the ceiling. The Theta(1) extension is asymptotic; unrestricted duplication of rows can change a finite assignment optimum.
Refuted by
- CE-DS-TILT-DUAL-GAP-001
The scalar-interest tilt-dual bracket is always exact: min_beta max_z between(S_psi-beta S_lambda; z) equals the exact global profiled-Ds value. FALSE: two explicit tilt quadratics give a rational lower certificate strictly above the exhaustive global optimum.
- CE-DS-TILT-DUAL-GAP-002
The scalar-POI tilt-dual duality gap needs N>=4 (support minimality of CE-DS-TILT-DUAL-GAP-001 across all K). FALSE: at N=3, K=2 the exact dual minimum strictly exceeds the exact global profiled value, and N=3 is the smallest support at which any exact-K>=2 problem has more than one labeling.
Closest prior work
- Li, Mathias (2000)Extremal Characterizations of the Schur Complement and Resulting Inequalities
- Silvey, Titterington (1973)A Geometric Approach to Optimal Design Theory
- Pukelsheim, Titterington (1983)General Differential and Lagrangian Theory for Optimal Experimental Design
- Fisher (1958)On Grouping for Maximum Homogeneity
Relationships
Rests on
- Variational form of the profiled objectiveDS-PROFILED-VARIATIONAL
- Scalar efficient-score upper problem is exactly solvable by dynamic programmingDS-SCALAR-EFFICIENT-DP
The full chain beneath it
Enables
- Profiled compile verdict is selected by an observable certificate stateDS-PROFILED-COMPILE-CERTIFICATE
- Best practical Ds solver with theorem-backed certificateOPEN-DS-PRACTICAL-CERTIFIED-SOLVER
Verified by
Open next door
Local graph
The example
DS19. The tilt-DP bracket: weak certification, an order-one gap, and a value-consistent DS18 primal
Independent audit (2 Sep 2026,
AUDITS/AUDIT-DS-PRACTICAL-CERTIFIED-SOLVER-001.md). Verified with
hardened assumptions (Tier A), verified (T5, Tier B), umbrella
reduced with a narrower remainder. Independent exact falsification over
125,491 canonical partitions found zero weak-duality, DS11, contiguity or
refinement violations; closure saddle held on 54/54
exact- tables. Five hardenings, folded into the text below:
(H1) the tie lemma — at a fixed tilt an optimal labeling exists in which
every group of equal tilted values is wholly in one cell or split only among
pure-tied cells, so the interval-DP value is tie-order independent and the
bound (in fact after sorting, Grønlund et al. 2017)
holds with ties; the frozen text asserted this without proof.
(H2) the saddle gate is set-valued: a deterministic DP tie policy can
return a non-closing member of when the bracket
closes (CE-DS-TILT-DUAL-TIE-MASK-001, , pairwise-distinct
tilted values), so a reported open interval is not a gap certificate.
(H3) the certified- bracket's bit model is explicit:
singleton-versus-rest coercivity radius, subgradient oracle, exact
cutting-plane LP lower certificate, ellipsoid/GLS rounding discipline.
(H4) "support-minimal" holds for only; the overall minimum is
CE-DS-TILT-DUAL-GAP-002 (, , , gap
); the exact dual minimum of fixture 001 is at the
rational crossing , exact gap , so the
registered mixture bound is a lower certificate, as stated.
(H5) zero-weight rows are excluded and the collapsed-atom versus
unrestricted-row domain is named. Scope widened (audit §7.5): at
the exact dual minimiser is computable in polynomial bit
complexity for every — the breakpoints are roots of degree-
polynomials of polynomial height, so a bisection on the exact one-sided DP
derivatives certifies a rational or quadratic-irrational minimiser after
polynomially many probes; for fixed and variable
exact minimisation is arithmetic-polynomial by Toledo (1993) parametric
search. The (EXACT-PARAMETRIC-DP) question below is therefore narrowed to a
polynomial bit bound for fixed and to variable
. The audit authorizes no src/ change.
Normalization (protocol A). Tier A has , arbitrary , and finite positive rational weights. All empirical second moments are about the score-space origin: scores are not sample-centered. The decision variable on the comparison side is a nonempty -cell labeling. The generalized comparison domain uses DS11's pseudo-inverse value ; the ordinary in-bin domain is its subset with a nonsingular nuisance block. For , put
Let . By scalar contiguity this value is returned by the exact interval DP after sorting . Let
For the primal, a tie policy is part of the object. If is the set of DP-optimal labelings at , define
An implementation may use one deterministic member of ; that only weakens its lower bound. (Audit H2: it can also hide a closure — the member it holds need not be the saddle even when ; an open reported interval therefore certifies nothing about the gap.) The information-loss implication is a finite train-sample value interval. It supplies no held-out or population retention statement except in the named DS18 corollary below.
Theorem DS19.1 (the valid bracket and its exact closure gate)
On the generalized domain,
On the ordinary in-bin domain,
Thus the same dual is a ceiling on the whole DS11 pseudo-inverse class and, a fortiori, on DS9. A singular DP state is a valid generalized lower bound but is not an in-bin lower bound; the regular filter in is load-bearing.
Moreover the generalized bracket closes, , iff there are such that
Equivalently, maximizes over labelings and minimizes : it is a saddle pair. If in addition , the same equality certifies as an ordinary in-bin global optimum. At a singular block only the normal equation is meaningful; no quotient slope is asserted.
Proof. DS11 gives . Hence for every ,
Taking the indicated maxima and minimum proves weak duality and both lower bounds. If a saddle pair exists, all inequalities are equalities. Conversely, if , choose a primal maximizer and a dual minimizer . Then
Thus both inequalities are equalities: is DP-optimal at , and DS11's attainment set makes satisfy exactly the displayed normal equation. The same pair also gives an attained . The finite maximum of nonnegative convex quadratics attains its infimum after quotienting directions that are null for every empirical nuisance moment. ∎
Ties and duplicate tilts. Scalar contiguity supplies the exact value even when equal tilted values are pooled (audit H1, tie lemma: each mixed cell's term is convex in the tied mass it receives, so an optimal labeling keeps every tied group in one cell or only in pure-tied cells, and every tie order yields the same DP value; the labeling active on is contiguous in the order breaking ties by decreasing ). At a crossing, different row-level refinements can have the same DP value and different derivatives. Any active derivative is a valid subgradient of , but a closure certificate must exhibit the concrete labeling whose normal equation is checked. A deterministic score-only quantizer must be constant on an exact duplicate-score class; unrestricted finite row assignment is a larger comparison domain and must be named separately.
Theorem DS19.2 (what is polynomial, and the exact-computation reduction)
For a supplied rational , , one active labeling, its exact rational gradient, and the regular/generalized primal values are computable in rational operations by sorted interval DP. The map is a finite maximum of convex quadratics, hence convex. With rational input, full empirical nuisance span, and a requested rational tolerance , a standard separation-oracle convex method therefore returns certified rational lower/upper bounds on of width in time polynomial in the input bit length and . A search radius is observable: singleton-versus-rest nuisance partitions give a positive quadratic coercivity bound on the effective nuisance span; common-null directions are first quotiented out.
Exact algebraic computation was established in the frozen proof only when and are fixed; the audit widens this (H-scope above): polynomial bit complexity at for every , and arithmetic-polynomial exact minimisation for fixed , variable (Toledo 1993). The fixed- argument follows. The tilt-order arrangement, including its tie faces, has polynomial size then; each cell has contiguous candidates, and fixed-dimensional real-algebraic comparison of their quadratic envelopes returns the exact minimum. This is not polynomial jointly in variable .
The study's requested general exact polynomial-time claim is therefore reduced to one explicit assumption/question:
(EXACT-PARAMETRIC-DP) Does the oracle-defined convex envelope , with and part of the input, admit exact algebraic optimization in polynomial bit complexity, including active tie refinements, without materializing its potentially large parametric-DP envelope?
No exact-computation claim is inferred from crossings-plus-midpoints or from an -accurate convex solve.
Counterexample DS19.3 (strong duality can fail by order one)
CE-DS-TILT-DUAL-GAP-001 is the equal-weight table
with . All six canonical nonempty partitions are regular, so DS9 and DS11 coincide. Exact enumeration gives
For and ,
With , . The mixed quadratic has vertex and minimum . Therefore
Since , the proposed primal-dual bracket has at least the same
gap. The witness is support-minimal for : has only the
singleton partition. (Audit H4: over all the minimum is ,
CE-DS-TILT-DUAL-GAP-002: rows , equal weights,
, exactly at by the mixture
, gap . The exact minimum of the
envelope is at .)
This is genuinely , not merely a fixed-size notation. For , give the four displayed atoms total mass and add distinct bounded rational atoms of total mass . Cellwise Cauchy--Schwarz bounds show uniformly, for in a compact set, that every added-only cell contributes , while every cell containing a base atom perturbs its quadratic by . The mixed quadratic above is coercive, so all dual minimizers remain in one compact interval. The same cellwise argument applied to the scalar Schur formula (a base-singular cell has cross term and nuisance term ) gives and . Hence stays bounded below by a positive constant. This construction uses positive weights and makes no split-duplicate assumption.
Theorem DS19.4 (the DS18 strip DP is -consistent)
On the exact DS18 law, let be the exact three-interval DP labeling of the uncentered scalar values . It is computable in polynomial time. Almost surely, it is regular eventually and
Proof. DP optimality gives , so the equality is the ordinary scalar Schur formula, with no centering. DS18's selection-independent uniform codebook event and the unique equal-third scalar optimum imply that the DP cells converge, up to labels, to the fixed cuts . Bounded scores then transfer all cell moments. Consequently and , proving regularity and the limit. ∎
The audited DS18 disagreement inequality therefore applies to
. This is strictly a value statement. The interval seed can
be one-point exchange-unstable (CE-DS-INTERVAL-SEED-UNSTABLE-001), and raw
population-cut labels can be unstable
(CE-DS-NONCENTERED-POPULATION-CUT-UNSTABLE-001). Nothing here proves local
ascent selects the basin, exchange stability of , perturbation
robustness, or a compile authorization.
Tier B: the matrix-tilt outer problem is not quasiconvex
Weak duality still holds for . Convexity and even quasiconvexity
of the proposed outer log-determinant map fail. In
CE-DS-MATRIX-TILT-NONQUASICONVEX-001, take the eight centered equal-weight
rows , split the first two coordinates as POI and
the last two as nuisance, and take . The singleton partition is the
only nonempty partition and its blocks are . Hence
For , , and , the exact determinants are . Thus , disproving quasiconvexity and therefore convexity. The certified ceiling remains valid, but minimizing it is a nonconvex outer problem in general. Tier B closes disproved; no library approximation follows.
Observable decision rule and deployment boundary
- A regular exhibited saddle pair closes the bracket and certifies finite global optimality on both domains. A singular saddle certifies only the generalized DS11 problem.
- A nonzero bracket reports the interval (or when explicitly generalized). It does not authorize the word “optimal”. The counterexample proves the interval may stay macroscopically open.
- The projected full-efficient-score interval rule remains the currently established unconditional projected-problem compiler. It is not silently relabeled as an in-bin profiled solution.
- A DS14 companion rule requires the complete audited sequence hypotheses and margins (M1)--(M5). A measured nuisance floor, one finite root, or -consistency alone is diagnostic only.
- In every other state the correct profiled compile action is refusal.
This result authorizes no src/ or public API change. The theorem and both
counterexamples require a fresh independent audit before any compile surface
can consume them.
Self-adversarial notes. The dual ceiling, primal lower bound, and closure condition name their comparison domains separately. Exact-K nonempty cells are used; empty-cell conventions are not hidden. The fixed-tilt value tolerates ties, but a concrete closure labeling is mandatory. The order-one family does not use duplicate splitting. Cardinality remains for centered regular samples. The DS18 proof uses the raw rows and only a value limit. Estimated scores, score-estimation error, held-out performance, and law perturbations remain outside the claim.
Stop-condition verdict. TIER A REDUCED. Validity on both named domains, the exact saddle closure condition, an exact duality-gap counterexample, polynomial certified-accuracy computation, and DS18 -consistency are settled. General exact polynomial bit-complexity is reduced precisely to (EXACT-PARAMETRIC-DP). TIER B DISPROVED: the outer matrix-tilt map need not be quasiconvex. The deployment question is answered: finite brackets are honest diagnostics/certificates at closure, while compile authorization remains projected-rule, full DS14 companion hypotheses, or refusal.
Next dependency-blocking question. After the audit, (EXACT-PARAMETRIC-DP) is settled at (bit-polynomial) and for fixed (arithmetic-polynomial); does a polynomial bit bound hold for fixed with variable , and is variable hard? The deployment blocker is a selection theorem: which certified or -consistent labeling does a practical solver return, and when does it inherit exchange stability.
From Profiled Ds: from a sample to the population · chapter contents
Independently audited: verified with hardened assumptions (Tier A), verified (Tier B and T5), umbrella reduced to the narrowed `OPEN-DS-TILT-DUAL-EXACT-COMPLEXITY` remainder. The audit report.
Evidence: COUNTEREXAMPLES/CE-DS-TILT-DUAL-GAP-001.json. Measured, never theorem authority.