Agency Study, Synthetic Panel, or Causal Experiment: Choosing a Research Approach
An insights or marketing leader choosing a research approach usually starts from two known models: commission a full-service research agency, or run an AI persona panel for a fast directional read. Neither is built to answer a narrower question: of the specific actions under consideration, which one actually changes the outcome the team cares about.
Committing a large agency engagement to a question that only needed a controlled test of one action wastes budget and time. Treating a directional synthetic-panel read as adequate evidence for a high-stakes brand or pricing call risks a decision the read was never designed to support.
What Is the Agency Research Model?
A global research agency runs the traditional playbook: bespoke quantitative and qualitative work fielded against real respondents, plus brand-tracking programs, segmentation, advertising-effectiveness benchmarks, and a consulting layer. Kantar, for example, maintains proprietary brand-equity frameworks such as BrandZ, calibrated against years of real-respondent data (Kantar BrandZ). That depth is why agency studies remain the default for board-level brand decisions.
The tradeoff is scale. Real-respondent fieldwork, proprietary framework licensing, and a global consulting layer are built for a small number of high-stakes studies a year, not for a team that needs an answer on Tuesday.
What Is the Synthetic-Panel Model?
A newer category of tools generates AI personas from public and customer-provided data, then runs structured conversations or simulated focus-group panels against them. The output is conversational and directional: summaries, quotes, and a read on how a modeled audience might react to a concept, message, or pitch.
That model is useful for teams fielding many low-stakes questions in a short span: pre-testing a campaign angle, stress-testing stakeholder messaging, or prepping for an internal pitch. The output is a plausible read against a modeled population, not a fresh, statistically fielded sample.
What Both Models Leave Unanswered
Neither model, by design, runs a controlled comparison between two or more actions and estimates which one changes a specific outcome. An agency study describes what a market currently believes, prefers, or recalls. A synthetic panel describes how a modeled audience is likely to react to one concept at a time. Neither answers: if we ran action A instead of action B, which one moves the number we're tracking?
What Is a Controlled Causal Experiment?
Subconscious is a causal behavioral platform. It runs controlled experiments on simulated populations to estimate which product, pricing, packaging, or messaging action is more likely to change a specific behavior, compared against the alternatives under consideration. Learn how the experiments are designed.
When a decision depends on validation beyond simulation, a team can extend the same causal question to real human participants without changing what's being tested. That step matters most when a wrong call carries enough downside to justify confirming the simulated result against real behavior before committing.
Comparing the Three Models
| Approach | Respondent basis | What it answers | Fits best when |
|---|---|---|---|
| Full-service agency study | Real respondents fielded per study, plus proprietary benchmark frameworks | What a market currently believes, prefers, or recalls, measured with methodological rigor | The decision is category-defining and warrants board-level scrutiny |
| Synthetic persona panel | AI-generated personas modeled from public and provided data | A directional read on reaction to one concept, message, or pitch | The team has many low-stakes questions and needs a fast directional signal |
| Controlled causal experiment | Simulated population, with optional real-human validation | Which specific action is more likely to change a defined outcome, compared with the alternatives | The decision requires isolating the effect of one action, not just gauging reaction to it |
Where a Causal Experiment Doesn't Replace the Other Two
A causal experiment on a simulated population doesn't replace the global panel networks or decades-deep proprietary brand-equity frameworks an agency maintains, and it isn't a faster or cheaper alternative to any specific vendor without a current, sourced comparison to back that claim. Causal experimentation complements real-human validation rather than substituting for it: the simulated and human-validated results should answer the same causal question.
If the question is "what does the market currently think," an agency study or a synthetic panel already answers it. If the question is "which of these actions will actually move the outcome," that's the gap a controlled experiment is built to close. See how a study moves from a defined decision to a tested action.