Skip to content

Risk Propagation: One Rule, Not a Menu

Earlier versions of this framework offered a menu of propagation rules (multiplicative, minimum, harmonic, discounted) to pick from. That was a mistake: for a two-link chain at 0.8 and 0.7 they give anywhere from 0.50 to 0.75, and at most one can be right. This page fixes the rule:

Compose multiplicatively. Correct for common-cause correlation. Treat the minimum rule as the fully correlated limit, not an alternative. Against an adaptive adversary, assume the fully correlated limit.

Two composition problems, one piece of math

Section titled “Two composition problems, one piece of math”

Propagation questions come in two shapes that behave oppositely:

  1. Serial chains (delegation). A delegates to B, and B to C. The chain works only if every link works. Each link has working probability tit_i = P(the link executes faithfully).
  2. Parallel defenses (stacks of checks). A harmful action gets through only if every layer misses it. Each layer has miss probability pip_i.

Under independence, both compose by multiplication. This is not a modeling choice; it is the definition of independence:

P(chain works)=∏itiP(all layers miss)=∏ipiP(\text{chain works}) = \prod_i t_i \qquad P(\text{all layers miss}) = \prod_i p_i

So the multiplicative rule is the correct baseline.

Components are rarely independent. They share providers, training methods, infrastructure and context (see the entanglement taxonomy). The standard one-parameter fix comes from common-cause failure analysis in nuclear probabilistic risk assessment, the beta-factor model. With weight ρ\rho, a shared cause takes down all the correlated components together; with weight 1−ρ1-\rho, they fail independently:

P(all fail)  ≈  (1−ρ)∏ipi  +  ρ⋅min⁡ipiP(\text{all fail}) \;\approx\; (1-\rho)\prod_i p_i \;+\; \rho \cdot \min_i p_i

The formula is exact for the mixture model it describes. It gives the product rule at ρ=0\rho = 0 and the minimum rule at ρ=1\rho = 1. The menu was a correlation parameter in disguise.

Simulation: which rule matches ground truth

Section titled “Simulation: which rule matches ground truth”

We modeled ground truth as a one-factor Gaussian copula: each component’s failure is driven partly by a shared latent factor with correlation ρ\rho, and each component fails with probability 0.1. The values below are computed by numerical integration over the shared factor; a 400,000-sample Monte Carlo agrees to within sampling error.

Parallel stack: P(all layers miss), two and three layers.

ρ\rho (latent)True (k=2)ProductMixtureTrue (k=3)ProductMixture
0.00.01000.01000.01000.00100.00100.0010
0.20.01720.01000.02800.00420.00100.0208
0.40.02670.01000.04600.01070.00100.0406
0.60.03900.01000.06400.02190.00100.0604
0.80.05620.01000.08200.04080.00100.0802

At latent ρ=0.4\rho = 0.4, the product rule understates the true risk by 2.7× for two layers and 11× for three. That is the safety-critical failure. The mixture column overshoots because the table’s ρ\rho is the copula’s latent correlation, a stronger scale than the mixture’s: latent 0.4 is a failure-indicator correlation of about 0.19 at p=0.1p = 0.1 (see what ρ means). Fed 0.19, the mixture gives exactly the true 0.0267 for two layers, and 0.019 against a true 0.011 for three. On matched scales it is exact for two layers and conservative beyond, the right side to err on.

Serial chain: P(both links work), t=(0.8,0.7)t = (0.8, 0.7).

ρ\rho (latent)TrueProductMixtureMinimum
0.00.5600.5600.5600.70
0.30.5910.5600.6020.70
0.60.6290.5600.6440.70
0.90.6800.5600.6860.70

Compare the two tables:

  • Serial chains: correlation helps, because failures bunch together. The product rule errs conservative and is safe unadjusted.
  • Parallel defenses: correlation hurts. Layers miss together. The product rule errs optimistic, by an order of magnitude at moderate correlation. Using it unadjusted is how a stack of three 90% layers ends up paying the entanglement tax.

So the operational rule is asymmetric:

SituationRule
Serial delegation chain, any ρ\rhoProduct of link reliabilities (conservative as is)
Parallel defenses, benign failures, ρ\rho estimatedMixture: (1−ρ)∏pi+ρmin⁡pi(1-\rho)\prod p_i + \rho \min p_i
Parallel defenses, ρ\rho unknown, layers share a provider, training or contextMinimum: count only your single best layer
Parallel defenses against an adaptive adversaryMinimum, unless a control evaluation measures the joint miss rate (see below)

For three layers that each miss 10%, the mixture gives P(all miss) = 0.001 + 0.099ρ, so the tax over the independence figure is 1 + 99ρ:

ρ (phi scale)P(all miss)Tax over independence
00.0011×
0.10.011~11×
0.20.021~21×
0.50.051~50×
10.100100×

The “~50×” figure quoted elsewhere on this site is the ρ = 0.5 row. It is a benchmark-based prior, not a measurement of any monitor stack. Recomputing joint miss rates from the per-pair data Kim et al. (2025) released for 71 models on MMLU gives ρ of about 0.3–0.6 for strong models from different providers and 0.5–0.7 within one provider, the ranges reflecting how much label noise is allowed for (Measuring Entanglement). So “use a different provider” lowers ρ only a little. No published study reports φ between LLM checks on harmful-action detection, and knowledge-question misses may not transfer to it. Until φ is measured for your stack, show the whole table, not one row.

The mixture is benign-failure math. It assumes inputs arrive independently of the defenses, and that layers fail together only through shared causes such as a common blind spot. The ρ in the recipe below is estimated on a fixed challenge set for the same reason.

An adaptive adversary breaks that assumption. A scheming component, the author of a prompt injection, or someone holding a jailbreak that transfers between models chooses inputs that defeat every layer at once. On those inputs, the layers’ misses are not a random draw from their benign miss rates. The effective correlation approaches 1, and the stack is worth at most its best single layer against that attack. It can be worth less, if the attacker searches until one input beats them all. The single-layer numbers are themselves optimistic: Nasr et al. (2025) bypassed 12 recent jailbreak and prompt-injection defenses with adaptive attacks, most at above 90% success, although most had reported near-zero attack success when first published.

So for the defection and hijack channels:

  1. Default to the minimum rule (ρ = 1). Count the stack as its best layer.
  2. Replace the default only with a measurement under attack. That means a control evaluation: a red team that knows the stack builds attacks against it, and you measure the joint miss rate on those attacks (Greenblatt et al. 2023). A φ computed on benign data does not transfer.
  3. Prefer defenses whose guarantee does not depend on ρ. A hard envelope blocks an action whatever the input. An architecture that keeps untrusted data out of control flow (Debenedetti et al. 2025) removes a class of attack instead of making it less likely.

The ~50× tax is therefore the benign-failure tax. Against an adaptive adversary, the honest prior is that three layers give you one.

  • Harmonic mean is incoherent for chains: for links (0.8, 0.7) it gives 0.747, higher than the weaker link. Retired.
  • Discounted product (an extra 0.9 per hop) double-counts, since multiplication already penalizes length. A residual worry about long chains is unmodeled correlation or context contamination; model those directly. Retired.
  • Minimum survives as the ρ=1\rho = 1 limit of the mixture: the honest bound when you cannot estimate ρ\rho or face an adversary.

The ρ\rho in the mixture is the beta-factor mixing weight: the share of failure probability attributable to a single shared cause. For layers with equal miss probability, it equals the Pearson correlation of the failure indicators (the phi coefficient). That is the scale on which ρ\rho should be estimated and reported.

It is not interchangeable with other numbers called “correlation”:

  • A latent or copula correlation, the kind a Gaussian-factor simulation is parameterized by, is larger than the indicator correlation it induces: latent 0.4 gives an indicator correlation of about 0.19 at p=0.1p = 0.1. Plugging a latent-scale number into the mixture or the tables overstates the tax.
  • The raw joint-failure share P(both fail)/P(either fails)P(\text{both fail})/P(\text{either fails}) (a Jaccard index) is nonzero even for independent layers (about 0.05 at p=0.1p = 0.1), so it is not a correlation at all.

The canonical estimation recipe (other pages reference this; do not substitute alternatives):

  1. Run all layers on the same labeled challenge set, recording each layer’s miss or catch on each item.
  2. For each pair of layers, compute the phi coefficient: ϕ=P(both miss)−pApBpA(1−pA) pB(1−pB)\phi = \dfrac{P(\text{both miss}) - p_A p_B}{\sqrt{p_A(1-p_A)\,p_B(1-p_B)}}.
  3. Use the largest pairwise ϕ\phi, or a deliberately high estimate, as the mixture’s ρ\rho.
  4. When you cannot measure, round up: assume ρ≈0.7\rho \approx 0.7 for layers that share a provider and 0.6 for strong LLMs from different providers (priors).

This recipe estimates benign-failure correlation only. For adversarial channels, see above.

Every ρ\rho in this page’s mixture columns and in the correlation calculator tables is on this indicator (phi) scale. The calculator’s per-configuration priors rest on benchmark data for the LLM rows and on judgment for the rest.

The mixture assumes one common cause shared symmetrically. Real systems have structured correlation: A and B share a provider, while C shares context with A. For those, build the pairwise matrix as in the entanglement worked examples, or simulate. Neither approach captures correlation beyond the pairwise; see Formal Definitions.