# Stochastic point-treatment regimes This study validates an ordinary known stochastic regime over two treatment arms. It compares `cleverly` with pinned R `lmtp` 1.5.4 on identical binary-outcome samples and exact treatment probabilities. The comparison runs through the shared point adapter rather than through `lmtp`'s shift interface. That interface takes a function of the natural treatment value, and this regime ignores that value. The adapter supplies the analytic density ratio and the shifted frame directly. The static regime uses `mtp = FALSE`. The tilt draws one treatment value per unit from the declared density and uses `mtp = TRUE`. Pinned `tmle3` stays unusable for this parameter, because `Param_TSM` evaluates a counterfactual at one treatment value and integrates over no density. ## Accuracy against known truth | law | estimand | what was tested | implementation | bias (99% interval) | coverage | SE ratio | result | | --- | --- | --- | --- | --- | --- | --- | --- | | binary-outcome law with a known stochastic treatment density | `ate_regime[tilt vs never]` | difference in means under the regimes "draw from the known stochastic tilt" against "assign no treatment" | `cleverly` | -0.000970 to 0.000901 | 0.9437 | 1.0142 | pass | | binary-outcome law with a known stochastic treatment density | `ate_regime[tilt vs never]` | difference in means under the regimes "draw from the known stochastic tilt" against "assign no treatment" | R `lmtp` | -0.000923 to 0.000980 | 0.9487 | 1.0295 | pass | | binary-outcome law with a known stochastic treatment density | `ey_regime[never]` | mean under the regime assign no treatment | `cleverly` | -0.0020 to 0.000657 | 0.9387 | 0.9948 | pass | | binary-outcome law with a known stochastic treatment density | `ey_regime[never]` | mean under the regime assign no treatment | R `lmtp` | -0.0020 to 0.000662 | 0.9375 | 0.9946 | pass | | binary-outcome law with a known stochastic treatment density | `ey_regime[tilt]` | mean under the regime draw from the known stochastic tilt | `cleverly` | -0.0018 to 0.000390 | 0.9375 | 0.9993 | pass | | binary-outcome law with a known stochastic treatment density | `ey_regime[tilt]` | mean under the regime draw from the known stochastic tilt | R `lmtp` | -0.0018 to 0.000482 | 0.9413 | 0.9976 | pass | ## Agreement with the canonical implementation Comparator-backed: a paired comparison with `lmtp` on the same samples. Each row reports estimate equivalence within the declared margin, the RMSE ratio and the coverage difference, and names its comparison kind. | law | estimand | what was compared | paired difference | share of margin used | RMSE ratio bound | coverage difference | comparison kind | calibration resolution | result | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | binary-outcome law with a known stochastic treatment density | `ate_regime[tilt vs never]` | difference in means under the regimes "draw from the known stochastic tilt" against "assign no treatment" | -0.000063 | 0.0403 | 0.9997 | -0.0050 | different estimator | 0.0387 vs 0.0500 | equivalent | | binary-outcome law with a known stochastic treatment density | `ey_regime[never]` | mean under the regime assign no treatment | -0.000001 | 0.000471 | 0.9981 | 0.0012 | different estimator | 0.0013 vs 0.0500 | equivalent | | binary-outcome law with a known stochastic treatment density | `ey_regime[tilt]` | mean under the regime draw from the known stochastic tilt | -0.000064 | 0.0348 | 0.9899 | -0.0037 | different estimator | 0.0176 vs 0.0500 | equivalent | ## Theory properties | property | cell | role | what was tested | what must hold | measured | result | | --- | --- | --- | --- | --- | --- | --- | | `density_necessity` | `tilt__declared` | positive | known stochastic tilt: the estimator integrates over the declared covariate-dependent treatment density | bias interval inside the equivalence margin | bias -0.000592 to 0.000920, margin 0.0025 | pass | | `density_necessity` | `tilt__uniform_control` | control | known stochastic tilt: the same fit replaces the declared density with a uniform distribution | bias interval must fall entirely outside the margin | bias 0.0269 to 0.0285, margin 0.0026 | pass | | `double_robustness` | `both_correct` | positive | both the outcome regression and the treatment mechanism are correctly specified | bias interval inside the equivalence margin, with the reported standard error on the scale of the empirical spread | bias -0.000926 to 0.000563, margin 0.0025, SE ratio 0.9980 | pass | | `double_robustness` | `both_wrong` | control | both nuisances are misspecified | bias interval must fall entirely outside the margin, with the reported standard error still on the scale of the empirical spread | bias -0.1967 to -0.1954, margin 0.0022, SE ratio 2.1881 | pass | | `double_robustness` | `outcome_correct` | positive | only the outcome regression is correctly specified | bias interval inside the equivalence margin, with the reported standard error on the scale of the empirical spread | bias -0.000754 to 0.000361, margin 0.0019, SE ratio 2.3099 | pass | | `double_robustness` | `treatment_correct` | positive | only the treatment mechanism is correctly specified | bias interval inside the equivalence margin, with the reported standard error on the scale of the empirical spread | bias -0.0011 to 0.000477, margin 0.0027, SE ratio 1.0028 | pass | | `interval_calibration` | `tilt__correctly_specified` | positive | known stochastic tilt: both nuisances are correctly specified with an independently computed efficiency bound | SE ratio and coverage intervals both inside their calibration bands, with both efficiency-ratio intervals inside their bands | coverage 0.9445 to 0.9619, SE ratio 0.9796 to 1.0372, empirical efficiency ratio 0.9625 to 1.0191, reported efficiency ratio 0.9971 to 0.9996 | pass | | `interval_calibration` | `tilt__noise_control` | control | known stochastic tilt: one efficiency-bound unit of independent noise is added to each estimate | the empirical efficiency ratio must rise above the band | coverage 0.8238 to 0.8539, SE ratio 0.6954 to 0.7353, empirical efficiency ratio 1.3579 to 1.4358, reported efficiency ratio 0.9971 to 0.9997 | pass | | `interval_calibration` | `tilt__shrunken_se_control` | control | known stochastic tilt: the reported standard errors are multiplied by a declared factor below one | the SE-ratio interval must fall below the calibration band | coverage 0.8150 to 0.8457, SE ratio 0.6863 to 0.7265, empirical efficiency ratio 0.9620 to 1.0183, reported efficiency ratio 0.6979 to 0.6998 | pass | | `power` | `alternative` | positive | the same test applied to a law with a real effect | rejection lower bound clears the minimum power | rejection 1, 0.9934 to 1 | pass | | `root_n_and_efficiency` | `n_2000` | positive | bias, coverage and SE calibration at n = 2,000 | bias inside the margin, coverage clears the floor, SE ratio inside the sanity band | bias -0.000196, coverage 0.9223 to 0.9647, SE ratio 1.0015 | pass | | `root_n_and_efficiency` | `n_500` | control | bias, coverage and SE calibration at n = 500 | coverage interval lies below nominal or clears the declared floor | bias -0.000643, coverage 0.9208 to 0.9637, SE ratio 0.9871 | pass | | `root_n_and_efficiency` | `n_8000` | positive | bias, coverage and SE calibration at n = 8,000 | bias inside the margin, coverage clears the floor, SE ratio inside the sanity band | bias -0.000148, coverage 0.9267 to 0.9677, SE ratio 0.9718 | pass | | `root_n_rate` | `empirical_sd` | positive | log empirical spread of the estimates regressed on log n across three sizes | slope interval inside the root-n band and excluding -1/4 | slope -0.5273 to -0.4583 | pass | | `root_n_rate` | `reported_se` | positive | the same regression applied to the mean reported standard error | slope interval inside the root-n band and excluding -1/4 | slope -0.5019 to -0.4973 | pass | | `targeting_necessity` | `tilt__targeted` | positive | known stochastic tilt: the estimator fluctuates a misspecified outcome model, so targeting does all the adjusting | bias interval inside the equivalence margin | bias -0.000897 to 0.000709, margin 0.0027 | pass | | `targeting_necessity` | `tilt__untargeted` | control | known stochastic tilt: the identical fit with every fluctuation step removed | bias interval must fall entirely outside the margin | bias -0.2251 to -0.2250, margin 0.000208 | pass | | `type_i_error` | `sharp_null` | positive | a confounded law whose true contrast is exactly zero | one-sided rejection bound stays under the declared type-I ceiling | rejection 0.0512, 0.0333 to 0.0748 | pass | The property study tests double robustness, exact-EIF calibration, a confounded sharp null, and targeting. A paired control replaces the declared density with a uniform density. ## Measured values and declared margins | quantity | value | source | | --- | --- | --- | | `replicates` | 800 | replications | | `n` | 2000 | observations per replication | | `independent_tests_passed` | 6 | truth tests passing | | `independent_tests_total` | 6 | truth tests reported | | `paired_tests_passed` | 3 | paired comparisons passing | | `paired_tests_total` | 3 | paired comparisons reported | | `property_cells_passed` | 18 | property cells passing | | `property_cells_total` | 18 | property cells reported | | `max_standardized_bias` | 0.0588 | largest primary standardized bias | | `min_coverage` | 0.9375 | lowest primary coverage | | `max_margin_utilization` | 0.0403 | largest paired similarity-margin share | | `margin:confidence_level` | 0.9900 | Monte Carlo confidence level | | `margin:alpha` | 0.0500 | test size | | `margin:nominal_coverage` | 0.9500 | nominal interval coverage | | `margin:bootstrap_replicates` | 10000 | bootstrap replications | | `margin:standardized_bias` | 0.2500 | standardized-bias margin | | `margin:coverage_floor` | 0.9000 | primary coverage floor | | `margin:over_coverage_ceiling` | 0.9900 | descriptive overcoverage threshold | | `margin:se_ratio_sanity_lower` | 0.8000 | primary SE-ratio lower screen | | `margin:se_ratio_sanity_upper` | 1.2000 | primary SE-ratio upper screen | | `margin:calibration_se_ratio_lower` | 0.9300 | calibration SE-ratio lower bound | | `margin:calibration_se_ratio_upper` | 1.0700 | calibration SE-ratio upper bound | | `margin:calibration_coverage_lower` | 0.9200 | calibration coverage lower bound | | `margin:calibration_coverage_upper` | 0.9800 | calibration coverage upper bound | | `margin:type_i_ceiling` | 0.1000 | type-I upper bound | | `margin:paired_difference` | 0.1500 | paired-similarity margin | | `margin:rmse_noninferiority` | 1.1000 | RMSE non-inferiority bound | | `margin:coverage_noninferiority` | -0.0250 | coverage non-inferiority bound | | `margin:calibration_noninferiority` | 0.0500 | calibration non-inferiority bound | | `margin:minimum_power` | 0.8000 | minimum power lower bound | | `margin:root_n_slope` | -0.5000 | expected root-n slope | | `margin:root_n_slope_lower` | -0.6250 | root-n slope lower bound | | `margin:root_n_slope_upper` | -0.3750 | root-n slope upper bound | | `margin:excluded_slope` | -0.2500 | slower rate the interval must exclude | | `margin:union_model_se_lower` | 0.1000 | union-model SE-ratio screen, lower limit | | `margin:union_model_se_upper` | 10 | union-model SE-ratio screen, upper limit | | `margin:efficiency_ratio_lower` | 0.9000 | efficiency-ratio lower bound | | `margin:efficiency_ratio_upper` | 1.1000 | efficiency-ratio upper bound | | `margin:shrunken_se_factor` | 0.7000 | negative-control SE multiplier | | `margin:targeting_displacement` | 0.2500 | minimum targeting displacement | | `margin:necessity_displacement` | 0.2500 | minimum density-control displacement | ## Limits - The laws use binary treatment, binary outcome, and one three-level baseline covariate. - The primary working outcome model is logistic and the natural treatment mechanism is supplied exactly. - The intervention density is known, covariate dependent, and supported on both arms. - The study covers ordinary, non-cross-fitted targeting and pointwise Wald intervals. - It excludes missing outcomes, weights, clusters, simultaneous bands, and flexible learners. The [default-band study](default-simultaneous-bands.md) measures the default band of this study's subject fit. - It does not validate continuous-dose, incremental, or longitudinal stochastic interventions. - The reference evaluates its shifted regression at one draw from the declared density. It does not integrate over that density, so it carries a Monte Carlo variance that `cleverly` does not. - Both implementations fit a logistic outcome regression on the covariate as one numeric column. The paired comparison is therefore symmetric in its outcome model. The calibration claim for a correctly specified pair belongs to the `interval_calibration` cells, which use exact nuisances.