Stochastic point-treatment regimes#
This study validates an ordinary known stochastic regime over two treatment arms. It compares
cleverly with pinned R lmtp 1.5.4 on identical binary-outcome samples and exact treatment
probabilities.
The comparison runs through the shared point adapter rather than through lmtp’s shift interface.
That interface takes a function of the natural treatment value, and this regime ignores that
value. The adapter supplies the analytic density ratio and the shifted frame directly. The static
regime uses mtp = FALSE. The tilt draws one treatment value per unit from the declared density
and uses mtp = TRUE. Pinned tmle3 stays unusable for this parameter, because Param_TSM
evaluates a counterfactual at one treatment value and integrates over no density.
Accuracy against known truth#
law |
estimand |
what was tested |
implementation |
bias (99% interval) |
coverage |
SE ratio |
result |
|---|---|---|---|---|---|---|---|
binary-outcome law with a known stochastic treatment density |
|
difference in means under the regimes “draw from the known stochastic tilt” against “assign no treatment” |
|
-0.000970 to 0.000901 |
0.9437 |
1.0142 |
pass |
binary-outcome law with a known stochastic treatment density |
|
difference in means under the regimes “draw from the known stochastic tilt” against “assign no treatment” |
R |
-0.000923 to 0.000980 |
0.9487 |
1.0295 |
pass |
binary-outcome law with a known stochastic treatment density |
|
mean under the regime assign no treatment |
|
-0.0020 to 0.000657 |
0.9387 |
0.9948 |
pass |
binary-outcome law with a known stochastic treatment density |
|
mean under the regime assign no treatment |
R |
-0.0020 to 0.000662 |
0.9375 |
0.9946 |
pass |
binary-outcome law with a known stochastic treatment density |
|
mean under the regime draw from the known stochastic tilt |
|
-0.0018 to 0.000390 |
0.9375 |
0.9993 |
pass |
binary-outcome law with a known stochastic treatment density |
|
mean under the regime draw from the known stochastic tilt |
R |
-0.0018 to 0.000482 |
0.9413 |
0.9976 |
pass |
Agreement with the canonical implementation#
Comparator-backed: a paired comparison with lmtp on the same samples. Each row reports estimate equivalence within the declared margin, the RMSE ratio and the coverage difference, and names its comparison kind.
law |
estimand |
what was compared |
paired difference |
share of margin used |
RMSE ratio bound |
coverage difference |
comparison kind |
calibration resolution |
result |
|---|---|---|---|---|---|---|---|---|---|
binary-outcome law with a known stochastic treatment density |
|
difference in means under the regimes “draw from the known stochastic tilt” against “assign no treatment” |
-0.000063 |
0.0403 |
0.9997 |
-0.0050 |
different estimator |
0.0387 vs 0.0500 |
equivalent |
binary-outcome law with a known stochastic treatment density |
|
mean under the regime assign no treatment |
-0.000001 |
0.000471 |
0.9981 |
0.0012 |
different estimator |
0.0013 vs 0.0500 |
equivalent |
binary-outcome law with a known stochastic treatment density |
|
mean under the regime draw from the known stochastic tilt |
-0.000064 |
0.0348 |
0.9899 |
-0.0037 |
different estimator |
0.0176 vs 0.0500 |
equivalent |
Theory properties#
property |
cell |
role |
what was tested |
what must hold |
measured |
result |
|---|---|---|---|---|---|---|
|
|
positive |
known stochastic tilt: the estimator integrates over the declared covariate-dependent treatment density |
bias interval inside the equivalence margin |
bias -0.000592 to 0.000920, margin 0.0025 |
pass |
|
|
control |
known stochastic tilt: the same fit replaces the declared density with a uniform distribution |
bias interval must fall entirely outside the margin |
bias 0.0269 to 0.0285, margin 0.0026 |
pass |
|
|
positive |
both the outcome regression and the treatment mechanism are correctly specified |
bias interval inside the equivalence margin, with the reported standard error on the scale of the empirical spread |
bias -0.000926 to 0.000563, margin 0.0025, SE ratio 0.9980 |
pass |
|
|
control |
both nuisances are misspecified |
bias interval must fall entirely outside the margin, with the reported standard error still on the scale of the empirical spread |
bias -0.1967 to -0.1954, margin 0.0022, SE ratio 2.1881 |
pass |
|
|
positive |
only the outcome regression is correctly specified |
bias interval inside the equivalence margin, with the reported standard error on the scale of the empirical spread |
bias -0.000754 to 0.000361, margin 0.0019, SE ratio 2.3099 |
pass |
|
|
positive |
only the treatment mechanism is correctly specified |
bias interval inside the equivalence margin, with the reported standard error on the scale of the empirical spread |
bias -0.0011 to 0.000477, margin 0.0027, SE ratio 1.0028 |
pass |
|
|
positive |
known stochastic tilt: both nuisances are correctly specified with an independently computed efficiency bound |
SE ratio and coverage intervals both inside their calibration bands, with both efficiency-ratio intervals inside their bands |
coverage 0.9445 to 0.9619, SE ratio 0.9796 to 1.0372, empirical efficiency ratio 0.9625 to 1.0191, reported efficiency ratio 0.9971 to 0.9996 |
pass |
|
|
control |
known stochastic tilt: one efficiency-bound unit of independent noise is added to each estimate |
the empirical efficiency ratio must rise above the band |
coverage 0.8238 to 0.8539, SE ratio 0.6954 to 0.7353, empirical efficiency ratio 1.3579 to 1.4358, reported efficiency ratio 0.9971 to 0.9997 |
pass |
|
|
control |
known stochastic tilt: the reported standard errors are multiplied by a declared factor below one |
the SE-ratio interval must fall below the calibration band |
coverage 0.8150 to 0.8457, SE ratio 0.6863 to 0.7265, empirical efficiency ratio 0.9620 to 1.0183, reported efficiency ratio 0.6979 to 0.6998 |
pass |
|
|
positive |
the same test applied to a law with a real effect |
rejection lower bound clears the minimum power |
rejection 1, 0.9934 to 1 |
pass |
|
|
positive |
bias, coverage and SE calibration at n = 2,000 |
bias inside the margin, coverage clears the floor, SE ratio inside the sanity band |
bias -0.000196, coverage 0.9223 to 0.9647, SE ratio 1.0015 |
pass |
|
|
control |
bias, coverage and SE calibration at n = 500 |
coverage interval lies below nominal or clears the declared floor |
bias -0.000643, coverage 0.9208 to 0.9637, SE ratio 0.9871 |
pass |
|
|
positive |
bias, coverage and SE calibration at n = 8,000 |
bias inside the margin, coverage clears the floor, SE ratio inside the sanity band |
bias -0.000148, coverage 0.9267 to 0.9677, SE ratio 0.9718 |
pass |
|
|
positive |
log empirical spread of the estimates regressed on log n across three sizes |
slope interval inside the root-n band and excluding -1/4 |
slope -0.5273 to -0.4583 |
pass |
|
|
positive |
the same regression applied to the mean reported standard error |
slope interval inside the root-n band and excluding -1/4 |
slope -0.5019 to -0.4973 |
pass |
|
|
positive |
known stochastic tilt: the estimator fluctuates a misspecified outcome model, so targeting does all the adjusting |
bias interval inside the equivalence margin |
bias -0.000897 to 0.000709, margin 0.0027 |
pass |
|
|
control |
known stochastic tilt: the identical fit with every fluctuation step removed |
bias interval must fall entirely outside the margin |
bias -0.2251 to -0.2250, margin 0.000208 |
pass |
|
|
positive |
a confounded law whose true contrast is exactly zero |
one-sided rejection bound stays under the declared type-I ceiling |
rejection 0.0512, 0.0333 to 0.0748 |
pass |
The property study tests double robustness, exact-EIF calibration, a confounded sharp null, and targeting. A paired control replaces the declared density with a uniform density.
Measured values and declared margins#
quantity |
value |
source |
|---|---|---|
|
800 |
replications |
|
2000 |
observations per replication |
|
6 |
truth tests passing |
|
6 |
truth tests reported |
|
3 |
paired comparisons passing |
|
3 |
paired comparisons reported |
|
18 |
property cells passing |
|
18 |
property cells reported |
|
0.0588 |
largest primary standardized bias |
|
0.9375 |
lowest primary coverage |
|
0.0403 |
largest paired similarity-margin share |
|
0.9900 |
Monte Carlo confidence level |
|
0.0500 |
test size |
|
0.9500 |
nominal interval coverage |
|
10000 |
bootstrap replications |
|
0.2500 |
standardized-bias margin |
|
0.9000 |
primary coverage floor |
|
0.9900 |
descriptive overcoverage threshold |
|
0.8000 |
primary SE-ratio lower screen |
|
1.2000 |
primary SE-ratio upper screen |
|
0.9300 |
calibration SE-ratio lower bound |
|
1.0700 |
calibration SE-ratio upper bound |
|
0.9200 |
calibration coverage lower bound |
|
0.9800 |
calibration coverage upper bound |
|
0.1000 |
type-I upper bound |
|
0.1500 |
paired-similarity margin |
|
1.1000 |
RMSE non-inferiority bound |
|
-0.0250 |
coverage non-inferiority bound |
|
0.0500 |
calibration non-inferiority bound |
|
0.8000 |
minimum power lower bound |
|
-0.5000 |
expected root-n slope |
|
-0.6250 |
root-n slope lower bound |
|
-0.3750 |
root-n slope upper bound |
|
-0.2500 |
slower rate the interval must exclude |
|
0.1000 |
union-model SE-ratio screen, lower limit |
|
10 |
union-model SE-ratio screen, upper limit |
|
0.9000 |
efficiency-ratio lower bound |
|
1.1000 |
efficiency-ratio upper bound |
|
0.7000 |
negative-control SE multiplier |
|
0.2500 |
minimum targeting displacement |
|
0.2500 |
minimum density-control displacement |
Limits#
The laws use binary treatment, binary outcome, and one three-level baseline covariate.
The primary working outcome model is logistic and the natural treatment mechanism is supplied exactly.
The intervention density is known, covariate dependent, and supported on both arms.
The study covers ordinary, non-cross-fitted targeting and pointwise Wald intervals.
It excludes missing outcomes, weights, clusters, simultaneous bands, and flexible learners. The default-band study measures the default band of this study’s subject fit.
It does not validate continuous-dose, incremental, or longitudinal stochastic interventions.
The reference evaluates its shifted regression at one draw from the declared density. It does not integrate over that density, so it carries a Monte Carlo variance that
cleverlydoes not.Both implementations fit a logistic outcome regression on the covariate as one numeric column. The paired comparison is therefore symmetric in its outcome model. The calibration claim for a correctly specified pair belongs to the
interval_calibrationcells, which use exact nuisances.