Why a Bayesian Marketing Mix Model Still Needs Calibration Before You Reallocate Budget

Edited by Avi Yashchin, CEO and Co-Founder · August 7, 2026

A Bayesian Marketing Mix Model (MMM) can tell you which channel looks most effective. It cannot tell you, on its own, whether that estimate is trustworthy enough to move tens of millions of dollars. That gap is where reallocation decisions go wrong.

The decision a CMO actually faces

An MMM produces a channel-effectiveness estimate and a recommended budget split. The question in front of a CMO or VP of Marketing Analytics isn't whether to trust the model. It's whether to act on the MMM's output as-is, or require calibration against an incrementality experiment (a holdout or geo-experiment) before shifting spend.

Getting this wrong is expensive in a specific way. If the model's estimated effect for a channel is inflated by unmodeled multicollinearity between correlated media spends, or by adstock and saturation assumptions that don't hold in practice, the team reallocates spend toward that channel expecting a lift that isn't there. The shortfall only shows up after the budget has already moved.

Structure of a Media Mix Model

A Bayesian MMM regresses an outcome, typically revenue or conversions, on media spend across channels, plus controls for seasonality, pricing, and other demand drivers. Two structural choices matter most for the estimate:

Adstock: media spend rarely converts in the week it runs. Adstock functions model the carryover effect of an impression over following weeks.
Saturation: each channel's return diminishes as spend increases. Saturation functions capture that diminishing return so the model doesn't extrapolate a straight line past the point where it breaks down.

The Bayesian treatment adds priors over these functions and produces a distribution over the channel-effectiveness estimate rather than a single point value. It does not, by itself, resolve the deeper problem: media spend across channels is often correlated, and a correlational model can attribute an effect to the wrong channel when two channels move together.

Why calibration is the step that closes the gap

Google Research published a methodology for calibrating Bayesian MMM priors against experimental results, using incrementality experiments to constrain what the model is otherwise unable to distinguish from spend patterns alone. The logic is straightforward: an incrementality experiment (a geo holdout, for example) produces a causal, ground-truth estimate of a channel's effect for the tested period. Feeding that estimate into the MMM as an informed prior narrows the range of channel-effectiveness values the model will accept, instead of leaving it to infer the answer purely from historical correlation.

Marketing measurement practitioners describe the same requirement from the buyer's side: an MMM without calibration is a starting hypothesis, not a validated budget plan.

What calibration does not fix

MMM remains a correlational, aggregate-level model even after calibration. Calibration reduces the bias that comes from multicollinear spend and unconstrained adstock or saturation curves. It does not eliminate it, and it does not turn the model into a causal method on its own. A calibrated MMM is still an estimate built from historical spend and outcome data, refined by whatever experimental evidence was available to anchor it. It does not test a new, specific reallocation before you commit to it.

Where causal testing fits before the budget moves

Subconscious runs controlled causal experiments to test a specific action, such as a candidate budget shift or channel reallocation, before it goes live, and compares scenarios with quantified uncertainty rather than a single point estimate. That complements MMM calibration rather than replacing it: calibration improves the model's estimate of what already happened; a configured causal study tests what would happen under the specific reallocation being considered.

Where the decision depends on validating a result against real behavior, a team can move from a simulated causal study to a study with real human participants without changing the underlying causal question being tested.

Five-step chain: correlated spend leads to the model failing to isolate each channel's effect, then misattribution, then a budget shift toward the inflated estimate, then a late-visible shortfall. — When channel spend moves together, the model's attribution error doesn't surface until after the reallocation it caused.

Practical checklist before reallocating

Confirm the MMM's adstock and saturation assumptions were fit against your own channel mix, not a template setup.
Check whether any channel-effectiveness estimate has been calibrated against an incrementality experiment. If not, treat it as a hypothesis.
Before moving spend on the strength of an uncalibrated estimate, test the specific reallocation as its own causal question, ideally as a holdout or geo-experiment, or as a configured causal study, rather than reading the MMM output as a finished answer.

Five-step path from a raw Bayesian MMM estimate through calibration against an incrementality experiment, noting the model stays correlational, to a causal test of the specific reallocation, ending in the budget move. — Calibration fixes the model's bias; only a causal test of the specific reallocation shows what it will actually do.

Testing a specific budget reallocation as a controlled causal question, rather than reading it directly off an MMM, is one way to see whether the estimate holds before spend moves. Learn how Subconscious runs causal studies.