Why a Bayesian Marketing Mix Model Still Needs Calibration Before You Reallocate Budget
On this page
A Bayesian Marketing Mix Model (MMM) can tell you which channel looks most effective. It cannot tell you, on its own, whether that estimate is trustworthy enough to move tens of millions of dollars. That gap is where reallocation decisions go wrong.
The decision a CMO actually faces
An MMM produces a channel-effectiveness estimate and a recommended budget split. The question in front of a CMO or VP of Marketing Analytics isn't whether to trust the model. It's whether to act on the MMM's output as-is, or require calibration against an incrementality experiment (a holdout or geo-experiment) before shifting spend.
Getting this wrong is expensive in a specific way. If the model's estimated effect for a channel is inflated because spend was allocated in anticipation of demand, or by adstock and saturation assumptions that don't hold in practice, the team reallocates spend toward that channel expecting a lift that isn't there. The shortfall may emerge after reallocation, but matched experimental evidence, holdouts and sensitivity checks can reveal problems before spend moves.
What is the structure of a Media Mix Model?
A Bayesian MMM regresses an outcome, typically revenue or conversions, on media spend across channels, plus controls for seasonality, pricing, and other demand drivers. Two structural choices matter most for the estimate:
- Adstock: media spend rarely converts in the week it runs. Adstock functions model the carryover effect of an impression over following weeks.
- Saturation: each channel's return diminishes as spend increases. Saturation functions capture that diminishing return so the model doesn't extrapolate a straight line past the point where it breaks down.
Bayesian inference represents uncertainty under the chosen specification. It does not resolve correlated channels, endogenous spend or misspecified response curves by itself.
Why is calibration the step that closes the gap?
Google Research describes using experimental evidence to inform MMM priors. Carry over the experiment's uncertainty and match channel, spend contrast, period and estimand. The experiment may constrain effects that observational spend cannot distinguish, without guaranteeing every extrapolated response curve.
Marketing measurement practitioners describe the same requirement from the buyer's side: an MMM without calibration is a starting hypothesis, not a validated budget plan.
What calibration does not fix
An MMM can support causal interpretation when its identification assumptions and evidence justify the intervention effect. Experimental calibration constrains tested channels and regimes; residual confounding, incompatible estimands and extrapolation can remain. See Meridian's causal-inference documentation.
Where does causal testing fit before the budget moves?
A randomized choice experiment can compare offer or creative attributes and estimate effects on stated choices. It does not identify how a media-budget shift changes reach, auction delivery or actual conversions. Reserve allocation-effect validation for relevant operational lift, geo or other defensible intervention designs.
A human choice task can check whether a simulated preference effect transfers to participants. It still measures a different outcome from in-market media response, so specify what the comparison supports.
Practical checklist before reallocating
- Confirm the MMM's adstock and saturation assumptions were fit against your own channel mix, not a template setup.
- Check whether any channel-effectiveness estimate has been calibrated against an incrementality experiment. If not, treat it as a hypothesis.
- Define the proposed budget intervention and measure a relevant operational outcome with a suitable lift or geo design where feasible. A choice study can provide related preference evidence, but cannot substitute for market-level incrementality.
Define the budget contrast and operational outcome before selecting a test. If considering a Subconscious engagement, discuss the design and deliverables and confirm what allocation evidence the study will provide.