How to Scope a Simulated-Market Study Before You Procure One
A vague research brief produces a vague result. Before an insights, product, or pricing leader commits budget to a simulated-market study, the team needs one decision-specific question: the action being considered, the audience it affects, the alternatives on the table, and the outcome that changes what happens next.
Why a thematic question wastes the study budget
"What do customers think of our product?" is not a research question. It has no answer structure, so any result it produces is directional color, not something the team can act on. A standard market research process moves from defining the problem through data collection to a reportable conclusion, and each later stage depends on the problem being defined clearly at the start.[^1] A vague brief can lead a team to treat an underspecified study as settled evidence for a launch, price, or positioning call it was never designed to support, spending budget and the decision window without moving the decision.
Compare a weak brief to a strong one:
| Weak brief | Strong brief |
|---|---|
| "What do customers think of our product?" | "How do mid-market marketing managers evaluate our positioning against a named competitor?" |
| "Is our pricing correct?" | "Given three candidate pricing structures, which one wins acceptance from a startup CTO, and for what reason?" |
| "Will people like this message?" | "Does this message change stated intent to switch more than our current message, for the segment that owns the switching decision?" |
If a question cannot be written that specifically in one sentence, the study is not ready to scope.
The four inputs a decision-specific brief needs
1. The action under consideration
Name the concrete thing being compared: a price point, a message variant, a product concept, a positioning statement. "Improve our messaging" is not an action. "Lead with the outcome claim instead of the category claim" is.
2. The audience the decision affects
Name the buyer segments whose response actually changes the decision, not every segment the company could theoretically reach. A pricing decision for enterprise buyers does not need a self-serve consumer's reaction.
3. The alternatives being compared
A study needs at least two things to compare. Testing one message in isolation tells the team whether people reacted, not whether it works better than the current one or a competing option.
4. The outcome that changes what the team does next
Decide in advance what result would change the plan. If the team would ship the same roadmap regardless of what the study shows, the study is not tied to a decision and should not be funded.
Sizing the study once the question is scoped
These figures are planning examples from a comparable panel-style research setup, not current Subconscious defaults or guarantees:
- 4 to 6 segments is a workable range for comparing distinct buyer perspectives in one round; combine two segments if they would give essentially the same answer.
- 5 to 8 questions per session keeps the results manageable; more than that and synthesis becomes hard to act on.
- 15 to 30 minutes was a typical session length in that setup, a fraction of the time a real focus group or interview series takes.
- 3 to 5 iterations in a single day was achievable when a first round revealed confusing messaging and a revised version needed a same-day retest.
Use these as starting anchors when sizing a proposal, not as fixed rules for every engagement.
What this scoping work rules out
This scoping work also rules out engagements the method cannot support:
- Deep relationship building. A single study estimates a directional response; it does not replace ongoing customer relationships.
- Statistical-scale quantitative validation. A simulated study is a fast first pass, not a substitute for a large-sample field study when the decision requires that scale of proof.
- Emotionally nuanced topics. Some questions need the texture only real human participants provide.
- Regulatory mandates for real participant data. When a rule requires human data, a simulated study cannot satisfy that requirement.
None of these are failures of the method. They mark which questions belong in a simulated study and which do not.
Running the scoped question as a causal comparison
Once scoped, the engagement can take the form of a controlled experiment rather than an open-ended conversation. Subconscious.ai runs this kind of comparison on simulated markets: it tests specific alternatives, such as price points, messages, or product concepts, against a defined population, and estimates which action is more likely to move the stated behavioral outcome, reporting uncertainty where the study design supports it.
The public validation result behind that comparison: our best configuration reaches 87% of the measured human ceiling on one study, 0.832 rank correlation against the published human result, where two independent samples of real humans reach 0.959. Across all 43 studies that pass design filters the mean is 0.73, drawn from roughly 300 replicated human studies across 9 domains. See the causal fidelity paper. That result covers the simulated pass, not a guarantee of market performance, so the scoping boundaries still apply once the study runs.
When the scoped question still needs a human study
The same four boundaries apply after a simulated study comes back. A simulated result is directional evidence: it does not turn a causal action test into an observed usability session, a clinical trial, or a guarantee of results.
Where the decision is high-stakes, emotionally nuanced, or under such a mandate, the practical step is real-human validation: Subconscious can test or validate studies with real human participants. That step confirms the simulated answer; it does not replace the scoping work above.
Write the one-sentence decision question before requesting a proposal. If a vendor cannot state back the action, audience, alternatives, and outcome the study is meant to test, the engagement is not scoped yet. Review current research and methodology, or book a walkthrough.
[^1]: The Market Research Process, Lumen Learning, Introduction to Business.