Bellot's paper exposes two layers of instability in causal estimation
Even when identifiable, causal effects can jump discontinuously with tiny data changes
Causal inference from observational data has long been known to be fragile. Even when a causal effect is theoretically identifiable — meaning it can be uniquely expressed in terms of the observed data distribution — the effect can still be discontinuous: two arbitrarily close data distributions may yield very different causal effects. This was formally established by Robins and Ritov (1997) and is independent of the chosen estimator. Alexis Bellot's new paper, 'Two Layers of Instability in Causal Estimation,' builds on this by exposing a second, estimator-dependent layer of instability.
Bellot shows that many standard point estimates — such as inverse propensity weighted (IPW) estimators and regression-based estimators — can be interpreted as point summaries of a multimodal distribution over the space of structural causal models (SCMs). Because these summaries are not the full posterior, they can jump discontinuously as the data changes. In contrast, explicit posterior means and medians (e.g., from Bayesian causal models) are shown to be continuous in the data distribution. The paper offers a decision-theoretic taxonomy tied to the loss function implicitly optimized: estimators that minimize a loss misaligned with the causal effect itself are more prone to instability. This work has direct implications for scientists and engineers relying on causal methods for robust decision-making.
- Causal effects can be discontinuous functions of the data distribution even when identifiability holds (Robins & Ritov, 1997).
- IPW and regression estimators are shown to be discontinuous point summaries of multimodal posterior distributions over structural causal models.
- Posterior means and medians (e.g., Bayesian approaches) are provably continuous in the data distribution, offering greater stability.
Why It Matters
Selecting a stable estimator is as critical as identifiability for reliable causal inference in real-world applications.