Does a Synthetic Panel Replicate Wind-Developer Policy Preferences? The Luthi Replication

Edited by Avi Yashchin, CEO and Co-Founder · August 24, 2026

A synthetic replication of a 2011 fielded discrete-choice study on wind-energy policy preferences produced a rank correlation of r_s = .7884 (p = .0004) against the original developer survey. That is the evidence available to a research or policy lead deciding whether to trust directional signal from a synthetic panel before committing budget to a full fielded study of wind-project stakeholders.

The population problem this replication addresses

Wind-project developers are a narrow, hard-to-reach professional population. Fielding a new survey against them for every policy question (permit timelines, grid-access guarantees, incentive structures) is slow and expensive. Lüthi and Prässler used a discrete choice experiment to assess how these regulatory and incentive levers weigh on developer decisions, publishing their fielded results in Energy Policy in 2011. A synthetic panel re-ran the same comparison to check whether it recovers the same preference ordering. This case study does not document the operator, run date, or sample size behind this figure.

What was compared

What the correlation supports, and what it doesn't

A rank correlation of r_s = .7884 (p = .0004) is a statistically significant, directional agreement between two preference orderings. It doesn't claim exact prediction accuracy or measure how closely any individual developer's stated preference matched. Lüthi and Prässler surveyed a narrow population under a specific set of policy attributes; the aggregate rank correlation reported here says nothing about agreement at the level of individual attributes, so it cannot be extended to attributes or populations the original study didn't cover.

Deciding whether to trust the synthetic read

A policy-design or advocacy team facing this choice has the same three options available for any synthetic-versus-fielded question: act on the synthetic panel alone, commission a new fielded survey of developers, or run a matched replication first. The third path is the only one that produces a testable statistic before spending the fielded-research budget.

1. Confirm the fielded study covers the same policy levers under consideration.
2. Run a matched synthetic study against the same attributes and population framing.
3. Compute the rank correlation and report its significance alongside it, as above.
4. Use a significant, positive correlation as directional support for scoping the next fielded study, not as a substitute for one, and not as proof for policy attributes the replication didn't test.

Limitations and failure conditions

This is one replication of one study against one narrow professional population. It says nothing about how a synthetic panel performs against regulators, utilities, or the general public; each needs its own matched replication. The 2011 benchmark also predates the shift in most major wind markets from feed-in tariffs to auctions, CfDs, and merchant/PPA structures, so this correlation is a method check on the original attributes, not current guidance on today's incentive structures. A team moving from this directional read to a live campaign or incentive-design decision should validate the specific attributes in play, ideally with real human participants, before treating the synthetic ordering as final.

Teams evaluating policy-preference research more broadly can see how this replication compares to others on the leaderboard, and review the underlying method on about.