Randomized missing-outcome DR-TMLE#
This study validates randomized missing-outcome DR-TMLE on a binary trial with a response
mechanism that depends on treatment and baseline covariates. It supplies the known treatment
probability and compares the both-correct limit with R drtmle 1.1.2 at pinned commit
538a3a2.
The comparator boundary matters. R drtmle represents treatment and response through one joint
mechanism. cleverly implements separate treatment and observation mechanisms and the five
reduced regressions from the randomized missing-outcome construction. The paired comparison can
witness the shared both-correct limit; it cannot establish parity for that internal correction
cycle. Independent property cells test the two one-correct drift directions and mutate the cycle
directly.
Accuracy against known truth#
law |
estimand |
what was tested |
implementation |
bias (99% interval) |
coverage |
SE ratio |
result |
|---|---|---|---|---|---|---|---|
binary-outcome randomized law with MAR outcomes |
|
average treatment effect |
|
-0.000928 to 0.0050 |
0.9537 |
1.0224 |
pass |
binary-outcome randomized law with MAR outcomes |
|
average treatment effect |
R |
-0.000917 to 0.0050 |
0.9550 |
1.0238 |
pass |
binary-outcome randomized law with MAR outcomes |
|
counterfactual mean under no treatment |
|
-0.0032 to 0.0013 |
0.9575 |
1.0294 |
pass |
binary-outcome randomized law with MAR outcomes |
|
counterfactual mean under no treatment |
R |
-0.0032 to 0.0013 |
0.9613 |
1.0307 |
pass |
binary-outcome randomized law with MAR outcomes |
|
counterfactual mean under treatment |
|
-0.000839 to 0.0030 |
0.9513 |
1.0065 |
pass |
binary-outcome randomized law with MAR outcomes |
|
counterfactual mean under treatment |
R |
-0.000814 to 0.0031 |
0.9500 |
1.0075 |
pass |
Agreement with the canonical implementation#
Comparator-backed: a paired comparison with drtmle-r-mar on the same samples. Each row reports estimate equivalence within the declared margin, the RMSE ratio and the coverage difference, and names its comparison kind.
law |
estimand |
what was compared |
paired difference |
share of margin used |
RMSE ratio bound |
coverage difference |
comparison kind |
calibration resolution |
result |
|---|---|---|---|---|---|---|---|---|---|
binary-outcome randomized law with MAR outcomes |
|
average treatment effect |
-0.000009 |
0.0018 |
1.0022 |
-0.0012 |
different estimator |
0.0038 vs 0.0500 |
equivalent |
binary-outcome randomized law with MAR outcomes |
|
counterfactual mean under no treatment |
-0.000015 |
0.0040 |
1.0016 |
-0.0037 |
different estimator |
0.0035 vs 0.0500 |
equivalent |
binary-outcome randomized law with MAR outcomes |
|
counterfactual mean under treatment |
-0.000023 |
0.0073 |
1.0021 |
0.0013 |
different estimator |
0.0030 vs 0.0500 |
equivalent |
Repeated-sampling properties#
property |
cell |
role |
what was tested |
what must hold |
measured |
result |
|---|---|---|---|---|---|---|
|
|
positive |
the outcome regression and observation mechanism are correctly specified |
bias interval inside the margin, coverage clears the floor, SE ratio inside the band, SE ratio must remain between 0.1 and 10.0 |
bias -0.0051 to 0.0012, coverage 0.9121 to 0.9575, SE ratio 0.9701 |
pass |
|
|
control |
the outcome regression and observation mechanism are both misspecified |
bias interval must fall entirely outside the margin, SE ratio must remain between 0.1 and 10.0 |
bias -0.1327 to -0.1268, coverage 0.0070 to 0.0316, SE ratio 0.9983 |
pass |
|
|
positive |
the outcome regression is correct and the observation mechanism is misspecified |
bias interval inside the margin, coverage clears the floor, SE ratio inside the band, SE ratio must remain between 0.1 and 10.0 |
bias 0.000650 to 0.0063, coverage 0.9194 to 0.9627, SE ratio 1.0103 |
pass |
|
|
positive |
the outcome regression is misspecified and the observation mechanism is correct |
bias interval inside the margin, coverage clears the floor, SE ratio inside the band, SE ratio must remain between 0.1 and 10.0 |
bias -0.0017 to 0.0043, coverage 0.9341 to 0.9727, SE ratio 1.0282 |
pass |
|
|
positive |
five-reduction correction cycle: the correction scores after the complete five-reduction cycle |
the upper confidence endpoint is below the declared fraction of the initial-score lower endpoint |
score -3.342e-08 to 2.323e-07 |
pass |
|
|
control |
five-reduction correction cycle: the same correction scores before the cycle is run |
the lower confidence endpoint clears the declared unresolved-score floor |
score 0.0033 to 0.0038 |
pass |
|
|
positive |
average treatment effect: all three required nuisance functions are correctly specified with an independently computed efficiency bound |
SE ratio and coverage intervals both inside their calibration bands, with both efficiency-ratio intervals inside their bands |
coverage 0.9319 to 0.9563, SE ratio 0.9581 to 1.0289, empirical efficiency ratio 0.9717 to 1.0435, reported efficiency ratio 0.9985 to 1.0012 |
pass |
|
|
control |
average treatment effect: one efficiency-bound unit of independent noise is added to each estimate |
the empirical efficiency ratio must rise above the band |
coverage 0.8146 to 0.8540, SE ratio 0.6781 to 0.7297, empirical efficiency ratio 1.3703 to 1.4743, reported efficiency ratio 0.9985 to 1.0013 |
pass |
|
|
control |
average treatment effect: the reported standard errors are multiplied by a declared factor below one |
the SE-ratio interval must fall below the calibration band |
coverage 0.8059 to 0.8461, SE ratio 0.6694 to 0.7213, empirical efficiency ratio 0.9701 to 1.0456, reported efficiency ratio 0.6989 to 0.7009 |
pass |
|
|
positive |
bias, coverage and SE calibration at n = 2,000 |
bias inside the margin, coverage clears the floor, SE ratio inside the sanity band |
bias -0.000264, coverage 0.9392 to 0.9704, SE ratio 1.0032 |
pass |
|
|
control |
bias, coverage and SE calibration at n = 500 |
coverage interval lies below nominal or clears the declared floor |
bias 0.000770, coverage 0.9248 to 0.9599, SE ratio 0.9935 |
pass |
|
|
positive |
bias, coverage and SE calibration at n = 8,000 |
bias inside the margin, coverage clears the floor, SE ratio inside the sanity band |
bias 0.000680, coverage 0.9267 to 0.9613, SE ratio 0.9861 |
pass |
|
|
positive |
log empirical spread of the estimates regressed on log n across three sizes |
slope interval inside the root-n band and excluding -1/4 |
slope -0.5237 to -0.4723 |
pass |
|
|
positive |
the same regression applied to the mean reported standard error |
slope interval inside the root-n band and excluding -1/4 |
slope -0.5015 to -0.4987 |
pass |
The property grid reports the both-correct limit, outcome drift, observation drift, and a both-wrong control. It also tests root-n contraction, exact-law efficiency, interval calibration, and the five-reduction cycle’s empirical score reduction against the same scores before correction.
Measured values and declared margins#
quantity |
value |
source |
|---|---|---|
|
800 |
paired replications |
|
2000 |
observations per primary replication |
|
6 |
truth tests passing |
|
6 |
truth tests reported |
|
3 |
paired comparisons passing |
|
3 |
paired comparisons reported |
|
14 |
property cells passing |
|
14 |
property cells reported |
|
0.0631 |
largest primary standardized bias |
|
0.9500 |
lowest primary coverage |
|
0.0073 |
largest paired similarity-margin share |
|
0.9900 |
Monte Carlo confidence level |
|
0.0500 |
nominal test size |
|
0.9500 |
nominal interval coverage |
|
10000 |
bootstrap replications |
|
0.2500 |
standardized-bias margin |
|
0.1000 |
union-model SE-ratio screen, lower limit |
|
10 |
union-model SE-ratio screen, upper limit |
|
0.9000 |
primary coverage floor |
|
0.9900 |
descriptive overcoverage threshold |
|
0.8000 |
primary SE-ratio lower screen |
|
1.2000 |
primary SE-ratio upper screen |
|
0.9300 |
calibration SE-ratio lower bound |
|
1.0700 |
calibration SE-ratio upper bound |
|
0.9200 |
calibration coverage lower bound |
|
0.9800 |
calibration coverage upper bound |
|
0.1000 |
type-I upper bound |
|
0.1500 |
paired similarity margin in pooled SDs |
|
1.1000 |
RMSE-ratio noninferiority bound |
|
-0.0250 |
coverage-difference noninferiority bound |
|
0.0500 |
calibration-excess noninferiority bound |
|
0.8000 |
minimum power lower bound |
|
-0.5000 |
expected root-n slope |
|
-0.6250 |
root-n slope lower bound |
|
-0.3750 |
root-n slope upper bound |
|
-0.2500 |
slower rate the interval must exclude |
|
0.9000 |
efficiency-ratio lower bound |
|
1.1000 |
efficiency-ratio upper bound |
|
0.7000 |
negative-control SE multiplier |
|
0.0100 |
maximum closed-to-initial score-endpoint ratio |
|
0.0010 |
unresolved initial-score floor |
Limits#
The study covers binary treatment, binary outcome, one three-level baseline covariate, known 1:1 randomization, and an MAR response mechanism.
Initial outcome and observation regressions are finite-support oracles; the reduced regressions use linear and logistic models without cross-fitting.
The comparison uses pointwise Wald intervals. Its joint-mechanism R comparator establishes only the shared both-correct limit, not internal five-reduction parity.
The property grid declares no type-I error, power, or targeting cell. The ordinary missing-outcome study carries those three instruments for the
delta=path.The study excludes observational treatment assignment, weights, clusters, simultaneous bands, missing treatment, multinomial treatment, MNAR outcomes, and other DR-TMLE compositions. The default-band study measures the default band of this study’s subject fit.
The drift cells give the consistent nuisance as its exact law table, so the conditioning terms of the theorem are zero by construction. The cells measure the targeting, not one-wrong inference with an estimated nuisance.
Reproduction#
The fixture README, manifest, replications, paired decisions, and property results carry the protocol, provenance, and every published row.